-- Logs begin at Mon 2022-08-01 13:17:21 UTC, end at Mon 2022-08-01 14:40:37 UTC. -- Aug 01 14:00:00.555104 dv-cinder-787296-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 14:00:00.565027 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:00:00 2022] *** Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: nodename: dv-cinder-787296-13-iscsi Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: machine: x86_64 Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: clock source: unix Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: pcre jit disabled Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: detected number of CPU cores: 4 Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: current working directory: / Aug 01 14:00:00.567180 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: your processes number limit is 47680 Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: your memory page size is 4096 bytes Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: detected max file descriptor number: 2048 Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: lock engine: pthread robust mutexes Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: thunder lock: enabled Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 14:00:00.567853 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:00:00.607500 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: Python main interpreter initialized at 0x5618da8179c0 Aug 01 14:00:00.607500 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: python threads support enabled Aug 01 14:00:00.607500 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: your server socket listen backlog is limited to 100 connections Aug 01 14:00:00.607500 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:00:00.607888 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:00:00.607971 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: *** Operational MODE: preforking *** Aug 01 14:00:00.608226 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:00:00.608226 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: spawned uWSGI master process (pid: 80447) Aug 01 14:00:00.608443 dv-cinder-787296-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 01 14:00:00.611548 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: spawned uWSGI worker 1 (pid: 80458, cores: 1) Aug 01 14:00:00.611548 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: spawned uWSGI worker 2 (pid: 80459, cores: 1) Aug 01 14:00:00.611548 dv-cinder-787296-13-iscsi devstack@keystone.service[80447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:00:06.255544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.255544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.256359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.256359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.256778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.256778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.256880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.256880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.306256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:00:06.306443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:00:06.307086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:00:06.307304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] command line args: [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:00:06.307513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:00:06.307603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:00:06.307716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] command line args: [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:00:06.307797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ================================================================================ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:00:06.307995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:00:06.308081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] admin_token = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ================================================================================ {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:00:06.308269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_dir = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] admin_token = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_source = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] config_dir = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] debug = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.308898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] config_source = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] debug = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.309922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_config_append = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.310987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_config_append = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_dir = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_dir = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_file = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.311926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.312930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.313880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.314989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] publish_errors = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] publish_errors = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.315978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] standard_threads = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] standard_threads = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.316925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_journal = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_json = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] use_journal = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_stderr = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] use_json = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_syslog = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] use_stderr = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.317999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.318074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] use_syslog = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.318144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:06.318332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.318904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.319901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.320998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.321985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.322079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.322754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.322867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.323999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.324909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.325959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.326927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.327913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.328964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.329944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.330933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.331958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.332953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.333964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.334992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.335970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.336918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.337863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.338924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.339935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.340988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.341950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.342989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.external = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.343800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.external = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.password = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.344891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.token = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.password = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] auth.token = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.345996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.346977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.347911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.348975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.349911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.350965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.351941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.352986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.353910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.354956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.355885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.356949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.357904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.358950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.359885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.360927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.361925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.362976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.363904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.364955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.365897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.366954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.367994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.368928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.369677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.369845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.369963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.370784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.371927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.372853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.373986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.374929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.375978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.376903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.377997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] role.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] role.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.378926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.379957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.380891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.381927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.382967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.383889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.384746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.385360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.385521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.385645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.386947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.387997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.388923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.389881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.390951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.connection = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.391903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.392899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.393890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.394947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.395062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:00:06.395185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.395185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.395185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:06.395185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:00:06.423327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.423555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.423783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.423932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.424172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.424404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.432946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.433342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.463293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.463476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.463581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.463688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.517332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.517997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.567688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.567926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.568999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.569240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.632524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.632676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.632758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.632834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.632967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.633702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.657400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.657634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.657783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.657892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.658899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.659114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.670409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.670607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.683883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.684889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:00:06.701885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.702100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:00:06.702347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.702432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.702561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:00:06.702660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:00:06.702886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.702969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703089 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:00:06.703171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.703872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.704125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.713357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.713633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.713921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.714007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.714201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.714284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.714470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.714750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.721121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.721643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.725884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.726170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.726399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.726482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.726679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.726760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.726960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.727851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.728035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.728117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.728306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.728967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.729169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.729300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.729530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.729897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.752930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.753384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.754456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.754740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.754909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.755189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.759399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.760220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.760317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.760384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.760446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.760523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.767008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.767295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.767509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.767752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.771511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.771801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.771882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.772095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.772940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.773783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.789652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.789790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.789959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.790046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.794673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.794864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.797834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.797971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.798132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.798216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.802575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.802670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.805762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.805846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.809702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.809877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.810911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.811031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.811201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.811293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.827462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.827565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.827748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.827846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.828015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.828096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.828285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.828366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.835197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.835330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.836759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.836882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.837047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.837169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.840132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.840305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.840970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.841174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.841256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.852653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.852760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.852938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.853022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.853215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.853296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.854963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.855035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.871226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.871438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.874211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.874441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.877169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.877373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.879836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.879959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.881357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.881485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.881653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.881775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.882067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.882161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.888904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.889109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.890624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.890805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.893577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.893835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.893922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.894144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.894266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.894438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.894522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.894739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.903155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.903441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.903581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.903725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.903872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.904181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.910620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.910901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.911190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.911280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:00:06.911468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.911551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.911760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.911850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.912958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.913881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.914873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:00:06.950067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618da8179c0 pid: 80458 (default app) Aug 01 14:00:06.950509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618da8179c0 pid: 80459 (default app) Aug 01 14:00:06.953405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335f16-641c-44f8-989b-5a21946731eb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:06.953702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335f16-641c-44f8-989b-5a21946731eb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:06.954036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335f16-641c-44f8-989b-5a21946731eb None None] PATH_INFO: `/v3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:06.958356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon Aug 1 14:00:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:15.551535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:15.552101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:15.552101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:15.556584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:15.562789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:15.563253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:15.563347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:15.633352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: INFO dbcounter [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] Registered counter for database keystone Aug 01 14:00:15.654745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG oslo_db.sqlalchemy.engines [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:15.660964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writer thread running {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:15.847595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG passlib.handlers.bcrypt [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 14:00:15.853305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG passlib.handlers.bcrypt [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 14:00:15.904306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:15.905937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:16.043406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 14:00:16.194347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:16.265841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: INFO dbcounter [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] Registered counter for database keystone Aug 01 14:00:16.286417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG oslo_db.sqlalchemy.engines [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:16.294121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writer thread running {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:16.412241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659a0c6-fb4b-4c29-9f8f-6c98dff0b659 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:16.416467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:16.417142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:16.417424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:16.417700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:16.426080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:16.478615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 14:00:16.478892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9b105-83bb-4fa7-a8c9-9e26d5147268 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:16.489173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Aug 1 14:00:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:00:16.495383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:16.509934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8034e93-94d7-414d-944a-b954362233d8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:16.515025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:16.516139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:16.516434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:16.516716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] PATH_INFO: `/v3/projects/40846723d7f04d9ab8a9bf11d431617b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:16.518262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] RBAC: Authorizing `identity:get_project(project_id=40846723d7f04d9ab8a9bf11d431617b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:16.569235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 14:00:16.569858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872906e-b4d6-4bf0-a878-f7b4f0dc7373 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:16.575314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon Aug 1 14:00:16 2022] GET /identity/v3/projects/40846723d7f04d9ab8a9bf11d431617b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:18.573736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc688c-7fdb-4a88-9b6c-f2a8e52caef5 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:18.574268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc688c-7fdb-4a88-9b6c-f2a8e52caef5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:18.574373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc688c-7fdb-4a88-9b6c-f2a8e52caef5 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:18.578591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:18.584923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00061-319f-496b-8468-37911a95fe6b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:18.585455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00061-319f-496b-8468-37911a95fe6b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:18.585727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00061-319f-496b-8468-37911a95fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:18.607141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-77f00061-319f-496b-8468-37911a95fe6b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:18.608667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77f00061-319f-496b-8468-37911a95fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:18.616730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 14:00:18.640491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc688c-7fdb-4a88-9b6c-f2a8e52caef5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:18.652835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc688c-7fdb-4a88-9b6c-f2a8e52caef5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:18.657148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:18.657798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:18.658916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:18.658916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:18.667094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:18.668906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61577b-4dbf-4d8a-bc44-7458c4c8cfa7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:18.678131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Aug 1 14:00:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:00:18.684710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00061-319f-496b-8468-37911a95fe6b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:18.694208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00061-319f-496b-8468-37911a95fe6b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:18.698758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:18.699396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:18.699681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:18.699958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:18.701441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:18.703304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0698fc9-a91e-42fb-997a-09eeebec3a52 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:18.704886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon Aug 1 14:00:18 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:20.817534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd7dd-aaed-4c12-89aa-45f6059363bd None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:20.818547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd7dd-aaed-4c12-89aa-45f6059363bd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:20.818547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd7dd-aaed-4c12-89aa-45f6059363bd None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:20.819475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:20.826215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:20.826739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:20.827019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:20.848959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:20.850213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:20.879528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2af0-d689-4a46-86ae-798bb8bcf44a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:20.879960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2af0-d689-4a46-86ae-798bb8bcf44a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:20.880303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c2af0-d689-4a46-86ae-798bb8bcf44a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:20.881695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:20.887560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592855-8706-47aa-9ccf-e17593332250 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:20.888923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592855-8706-47aa-9ccf-e17593332250 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:20.888923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592855-8706-47aa-9ccf-e17593332250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:20.932103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG passlib.handlers.bcrypt [None req-32592855-8706-47aa-9ccf-e17593332250 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80459) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 14:00:20.932632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG passlib.handlers.bcrypt [None req-32592855-8706-47aa-9ccf-e17593332250 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80459) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 14:00:20.954363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:20.978235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:20.979545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-32592855-8706-47aa-9ccf-e17593332250 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:20.981273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-32592855-8706-47aa-9ccf-e17593332250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:21.002508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.100459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:21.109165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b91e-dc25-4af4-bbd4-b28e1323908f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.129631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592855-8706-47aa-9ccf-e17593332250 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.156020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.156681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.156962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.157246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.170289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:21.179216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:21.180501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:21.181915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:21.187223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.246236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592855-8706-47aa-9ccf-e17593332250 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.248815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.282583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.289016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.289952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.290249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.290533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.306270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb646e-d377-4477-8d83-1c758fdb5070 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.347603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.348240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.348532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.348808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.349543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:21.349883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.351348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.363848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:21.368141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.369416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.371025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.476043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:00:21.481953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468411a1-827e-4367-902e-f13c49da5404 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.482805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.485699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.604002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebfe7c-4105-41a6-980c-fca5de5dba15 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.630470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.631124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.631410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.631691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.632917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.634427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.636316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:21.641850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.644811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.645777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.646077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.646359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.656835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.674307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.677168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:00:21.706461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:21.707377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:21.708186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:00:21.708186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:00:21.708186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:00:21.708186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:21.708409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:21.716473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.754650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6ec1-6afa-4908-9bc4-961c9660ffc2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.788376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.800963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.801704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.802063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.802350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.803923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.806749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.809251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:21.815265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:21.836243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f450e-ed20-4a94-b707-0a0e5e9e761b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.878160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.878854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.879148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.879430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.880140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:21.880440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.881882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d593c-db93-4f75-8b0b-91f2ca07f975 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.903289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 10/20] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:21.910621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:21.933463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c812fb-97cd-4442-bbaf-af2dee9c8563 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:21.972163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:21.972796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:21.973081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:21.973359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:21.974198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.domain.id=default, user.id=f199c9c45ff44aa0a14a3b7dc647ab4c) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:21.974502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:21.975982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8111b8-ff1e-4aea-ba7c-ec012ed4802d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:21.984801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 11/21] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Aug 1 14:00:21 2022] GET /identity/v3/role_assignments?user.id=f199c9c45ff44aa0a14a3b7dc647ab4c&scope.domain.id=default&role.id=1c201ebfc669434982f999e02a45c09f => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:24.391071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657711-9d0d-4ac1-a5f9-e11de92669fa None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:24.392132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657711-9d0d-4ac1-a5f9-e11de92669fa None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:24.392642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657711-9d0d-4ac1-a5f9-e11de92669fa None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:24.394553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 11/22] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:24.411767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:24.412266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:24.412338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:24.435486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:24.436694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:24.535110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:24.571139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657711-9d0d-4ac1-a5f9-e11de92669fa None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:24.784605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657711-9d0d-4ac1-a5f9-e11de92669fa None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:24.804061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:24.832233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:24.833704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:24.834499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:24.835201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:24.853156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:24.855761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-8abf858f-ac5a-473e-8cee-4a301e3934eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:00:24.879245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:24.880117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:24.881381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:00:24.881381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:00:24.881381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:00:24.881381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:24.881381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 12/24] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:24.887211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:24.941709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23258f2-4043-4020-b4bd-cb1be35fa875 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:24.942256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23258f2-4043-4020-b4bd-cb1be35fa875 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:24.942791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23258f2-4043-4020-b4bd-cb1be35fa875 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:24.944302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 13/25] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:24.951169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8652a8-e7c2-4532-8d6a-bdfecebaacff None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:24.951672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8652a8-e7c2-4532-8d6a-bdfecebaacff None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:24.952102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8652a8-e7c2-4532-8d6a-bdfecebaacff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:24.983240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-cf8652a8-e7c2-4532-8d6a-bdfecebaacff None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:24.984719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cf8652a8-e7c2-4532-8d6a-bdfecebaacff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:25.009327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:25.039819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc148-32e3-4999-bb29-52c31f5460d7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:25.091421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:25.092331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.092772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.093215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.094094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:25.094545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:25.096213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9de92b-a42e-478e-bdb3-fcead11f86e2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:25.128075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 13/26] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:25.129832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5353c-103c-4ac0-a61c-060b2c94e273 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.130283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5353c-103c-4ac0-a61c-060b2c94e273 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.130711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5353c-103c-4ac0-a61c-060b2c94e273 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.132108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:25.133270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfedbb-6246-456f-9e08-f2f89e6be28a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.133746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfedbb-6246-456f-9e08-f2f89e6be28a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.134266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfedbb-6246-456f-9e08-f2f89e6be28a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.136309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 15/28] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:25.141356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfedbb-6246-456f-9e08-f2f89e6be28a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:25.148190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 14/29] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 01 14:00:25.149489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43064-0270-4db5-8958-d8da8dcdd460 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.153839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43064-0270-4db5-8958-d8da8dcdd460 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.154566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43064-0270-4db5-8958-d8da8dcdd460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.189219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-5fa43064-0270-4db5-8958-d8da8dcdd460 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:25.190480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5fa43064-0270-4db5-8958-d8da8dcdd460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:25.291360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfedbb-6246-456f-9e08-f2f89e6be28a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:25.334211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:25.334864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.335151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.335449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.336224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:25.337773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:25.344395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:25.420764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:25.422804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.423339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.423836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.443496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:25.445171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:25.482746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:25.535559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:25.536727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:25.654621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 16/32] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:00:25 2022] POST /identity/v3/projects => generated 301 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:25.656310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:25.656892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3084187-9568-4f23-8ffb-41eee1482aa6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:25.699287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:25.699965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.700253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.700536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.701280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:25.702787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:25.783212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d62f-6065-4984-adc9-88616ed5e980 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:25.828393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:25.829462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:25.830302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:25.830841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:25.855912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:25.862598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:25.863521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:25.864375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 17/33] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:25.873881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:25.935907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:25.977732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Aug 1 14:00:25 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:25.978768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:25.997402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be468-acc3-458a-a609-eec87d6693da None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.005923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.047832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.049049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.049500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.049854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.050605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.052239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47619549-af29-4445-9918-d2a043ae86cf None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.104940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503a1a-bd4c-43c6-a24b-e8e0aa0385df None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.126180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Aug 1 14:00:25 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:26.139468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f5d7-968d-460c-893e-772c472e96bb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.139782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f5d7-968d-460c-893e-772c472e96bb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.140086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8f5d7-968d-460c-893e-772c472e96bb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.141687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:26.142699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa45-8bd5-4a0e-aea1-e2fc1184e81a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.142988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa45-8bd5-4a0e-aea1-e2fc1184e81a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.143271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555fa45-8bd5-4a0e-aea1-e2fc1184e81a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.149794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 20/37] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:26.151001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.151306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.151690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.162627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.163650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.164051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.164476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.165798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:26.166274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.169963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bab28-3726-4ece-b512-08aea78fb021 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.191156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 18/38] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:26.192518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.192822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.193164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.202775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:26.204521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:26.213689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:26.215813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:26.305779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 21/39] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:26.305779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.326544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:26.340817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.350374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.358300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.429119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e140d4-661d-4f95-b64b-316a050a191a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.461029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8feef-c81f-4ddc-8dc8-ae247d171076 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.466195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.466887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.467180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.467465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.468790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.470314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.471932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 22/41] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:26 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:26.472681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.501334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.502015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.502308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.502601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.504029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.505502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.507149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 20/42] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:26.507923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.585474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29a53-e3b0-4c02-b0ab-3cd0dd299425 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.597808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.601122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.632685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5389a7-9f64-4687-83be-b0982abffe9b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.632926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.633550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.633871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.634153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.634897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.636934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.668856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.669502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:26.680622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.759077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Aug 1 14:00:26 2022] POST /identity/v3/roles => generated 223 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:26.769499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:26.791875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fd99-4f0d-43bf-8be3-5c1f80d50dae None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.841626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.842916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.842916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.842916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.843547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.845132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b05ba-56e0-4b0e-9af7-8c41221da273 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:26.910439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d19ac8-7a2e-48d3-bdad-b9f7f329dbc2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:26.951819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:26.957918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:26.958619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:26.958910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:26.959268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] PATH_INFO: `/v3/domains/default/users/f199c9c45ff44aa0a14a3b7dc647ab4c/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:26.960395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:00:26 2022] POST /identity/v3/projects => generated 312 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:26.961597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f199c9c45ff44aa0a14a3b7dc647ab4c, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:26.963176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73bdfd-c798-4f9c-adf2-9f9e7c4c8333 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:27.049162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 24/46] 10.222.0.49 () {58 vars in 1361 bytes} [Mon Aug 1 14:00:26 2022] PUT /identity/v3/domains/default/users/f199c9c45ff44aa0a14a3b7dc647ab4c/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:29.085555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0faf-37ca-45d1-87f7-a30d19674a1e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.086092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0faf-37ca-45d1-87f7-a30d19674a1e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.086197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0faf-37ca-45d1-87f7-a30d19674a1e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.087541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:29.093687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.094183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.094297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.101868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4521-25a6-496e-8631-70c989fb1ad2 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.102170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4521-25a6-496e-8631-70c989fb1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.102459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4521-25a6-496e-8631-70c989fb1ad2 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.103798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 24/48] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:29.111116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.111409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.111800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.112896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:29.114169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:29.132962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:29.133546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.134199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:29.198786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:29.208114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:29.226936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.231158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.335710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c052a6-d575-4e33-85ce-a30a047e09ee None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.342639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7e214-eb3a-49ca-8e46-73ee75dc3985 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.370142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.371889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.372544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.372831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.373125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.378000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.378650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.378939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.379911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.380427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:29.381930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:29.383401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:29.383540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:29.389732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:29.391482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:29.392930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:29.393943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.394057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:29.396787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.412910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.496017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee28eb-f4f5-4761-bc25-e96d002d5299 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.500643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e0f95-1245-4cac-88b1-4c8e052db35c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.530947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.531568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.531855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.532130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.532811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:29.534294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:29.536582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.537214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.537504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.537812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.538543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:29.538869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:29.540256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:29.549873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:29.555442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.636016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.666041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 27/54] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Aug 1 14:00:29 2022] POST /identity/v3/projects => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:00:29.666269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44588-11e6-4ecf-888c-7ce6731cbde9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.702028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.702784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.703415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.703711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.705149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:29.707125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:29.710029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:29.715508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.773009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:29.829425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631960bb-a544-4984-8ec5-91be36cfa217 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:29.864693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:29.865358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:29.865648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:29.865959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:29.868486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:29.871051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcbf41-82b5-482c-9229-22de9fc453a4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:29.872989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:29.878855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:29.984175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e5488-3a5b-44e4-854e-41139a969227 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:30.022805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:30.023441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:30.023734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:30.024019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:30.024817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.domain.id=default, user.id=f199c9c45ff44aa0a14a3b7dc647ab4c) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:30.025136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:30.026724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47150357-6385-4742-b288-a13fa24449d1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:30.032847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Aug 1 14:00:29 2022] GET /identity/v3/role_assignments?user.id=f199c9c45ff44aa0a14a3b7dc647ab4c&scope.domain.id=default&role.id=1c201ebfc669434982f999e02a45c09f => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:31.708465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5f9a-5c28-4004-abed-3f4c1a6ee540 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:31.709023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5f9a-5c28-4004-abed-3f4c1a6ee540 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:31.709023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5f9a-5c28-4004-abed-3f4c1a6ee540 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:31.710405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:31.716129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:31.716570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:31.716706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:31.735043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:31.736233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:31.738201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:31.803593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:31.827194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5f9a-5c28-4004-abed-3f4c1a6ee540 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:31.930164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5f9a-5c28-4004-abed-3f4c1a6ee540 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:31.946195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:31.964310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:31.964886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:31.965174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:31.965569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:31.966722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:31.968113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484043fc-2432-4d6f-af1d-3c2336f4798f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:31.969747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:31.975407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:32.086312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6343cc-fca4-432e-8d81-4ba725795b48 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:32.121432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:32.122081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:32.122370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:32.122679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:32.123369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:32.124817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af450-b50d-4041-b048-107baa2e5723 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:32.139321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:32.256644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:31 2022] POST /identity/v3/users => generated 275 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:35.325444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dca3c-b30d-46ba-b165-7bbd015dae76 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.326920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dca3c-b30d-46ba-b165-7bbd015dae76 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.327595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dca3c-b30d-46ba-b165-7bbd015dae76 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.329792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:35.336320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b053a1-3e67-453e-9e98-04e48d72fd8f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.337267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b053a1-3e67-453e-9e98-04e48d72fd8f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.338763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b053a1-3e67-453e-9e98-04e48d72fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.374779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a8b053a1-3e67-453e-9e98-04e48d72fd8f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:35.376324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a8b053a1-3e67-453e-9e98-04e48d72fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:35.501434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:35.547769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dca3c-b30d-46ba-b165-7bbd015dae76 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:35.693610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dca3c-b30d-46ba-b165-7bbd015dae76 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:35.742019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400282ef-683c-4e37-9aa0-604486cdc1ff None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.742534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400282ef-683c-4e37-9aa0-604486cdc1ff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.743076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400282ef-683c-4e37-9aa0-604486cdc1ff None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.743779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:35.745062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.745370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.745653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.746644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 33/64] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:35.753443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb76-7d72-44c9-a7ed-c515219cac78 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.754083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb76-7d72-44c9-a7ed-c515219cac78 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.754579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb76-7d72-44c9-a7ed-c515219cac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.767515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:35.773730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:35.774641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:35.775401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 32/65] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:35.783441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:35.808743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6820fb76-7d72-44c9-a7ed-c515219cac78 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:35.809992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6820fb76-7d72-44c9-a7ed-c515219cac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:35.878136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:35.943845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 34/66] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:35.945612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d9f1-697e-43f7-962b-c7a5dd668ca6 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.946145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d9f1-697e-43f7-962b-c7a5dd668ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.946638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d9f1-697e-43f7-962b-c7a5dd668ca6 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.953128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 35/67] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:35.954797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.955351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.955937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.958897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0bf0-0c12-4963-8dab-669c6e0aa717 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:35.975977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:35.977590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:35.996974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:35.997919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:35.998467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:35.998898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:35.999890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:36.000367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.001951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.012597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 33/68] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:36.014005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.039516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.060869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 36/69] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:36.062035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.150782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4c66e-cb7c-4d2e-bce6-77f59a15f88f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.158489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.189863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.190803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.191250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.191674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.192273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019ed44-f6ba-41d6-9d79-e8a3ea62fbfe None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.205494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:36.210772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:36.211793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:36.212702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:36.214741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 34/70] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:36.215700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.238900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.239562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.239953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.240188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.255264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.256740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7914e-f470-4ff9-ad19-db57a3753898 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.258458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:36.259822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38906-3285-4ce8-92f8-1b35cbdc1285 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.261166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38906-3285-4ce8-92f8-1b35cbdc1285 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.261575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38906-3285-4ce8-92f8-1b35cbdc1285 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.263132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 38/72] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:36.263973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38906-3285-4ce8-92f8-1b35cbdc1285 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.311038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.332877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aad99-5495-47c2-ae2a-1f0f1f7a7eac None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.373315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.373994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.374278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.374642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.380434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38906-3285-4ce8-92f8-1b35cbdc1285 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.386352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:36.396204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:36.397206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:36.398005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 35/73] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:36.399415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.424903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.425527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.425844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.426123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.426842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:36.427150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.428546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed145-c626-425c-88b3-6073e18a49e7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.433665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.438183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 39/74] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:36.439434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b741-2e37-4277-97ee-71f818aeefbf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.439725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b741-2e37-4277-97ee-71f818aeefbf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.440005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b741-2e37-4277-97ee-71f818aeefbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.458332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-acb7b741-2e37-4277-97ee-71f818aeefbf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:36.459474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-acb7b741-2e37-4277-97ee-71f818aeefbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:36.529430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7c1-da71-4c60-a101-b2d812bc60ad None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.541178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 40/75] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:36.543412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232f3-ef40-4330-9a35-1bca6f2428db None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.543700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232f3-ef40-4330-9a35-1bca6f2428db None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.543981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232f3-ef40-4330-9a35-1bca6f2428db None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.545265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 41/76] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:36.549810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239232f3-ef40-4330-9a35-1bca6f2428db None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.582017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.582647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.582936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.583218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.592137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.667415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.669048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97759c1-7342-4288-972d-28e9b4a434d2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.672337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239232f3-ef40-4330-9a35-1bca6f2428db None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.698625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.712467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.712467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.712467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.712780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.714157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:36.714487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.715919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.724933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 42/77] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:36.725795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.785908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 36/78] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:36.787268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.787563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.787883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.808029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:36.809245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:36.850280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:36.858496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dfbc-2fb3-4e90-9f57-164b0e89e3ec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:36.883403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 37/79] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:36.889958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.907052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:36.907052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:36.907052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:36.907052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:36.907959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:36.907959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:36.908182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 43/80] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:36.910152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:36.954155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.003198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb21d53-6f21-40e5-9608-45adc249fc7d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.013252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5853bf3-5541-435e-a5b2-d9b8024a75ef None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.040111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.040777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.041067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.041945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.052014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.052670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.052958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.053063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:37.053241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.054448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.055903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.057844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 44/81] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:37.058432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:37.059616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:37.060408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:37.061568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.061649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 38/82] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:37.061649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.108208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.180226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d24cb-a165-4ab8-bea0-e43dc7fc6a98 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.190140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5c5b2-9a37-41c4-b29c-c29f65957575 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.211469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.217972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.218633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.218920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.219200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.220447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.221937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.223625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 45/83] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.224470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.237359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.238043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.238773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.238773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.239762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.241499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.245849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 39/84] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.247245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.331250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.334573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dea0c-37fe-4c77-ad25-ce31bae68fb7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.357319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff60d-fb2c-4999-9a81-96aea25e70c0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.370561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.371198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.371495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.371789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.399672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.400672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.402419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.403001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.446368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.448502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.462725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.485019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.486749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.558074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.562115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 46/85] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:37.566694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.598325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:37.599197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.683942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b0365-1f18-4458-8f65-21fefc7c972e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.695442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.712173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515b0a5-a749-4974-9475-77aa66d74315 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.725084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.725870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.726207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.726548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.727380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:37.727748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.729207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.737534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 47/87] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.738348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.748812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.749452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.749743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.750048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.750930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:37.751246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.752723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.768106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 41/88] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.768528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:37.848170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:37.922537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64c78-a8e2-4ba4-9598-c94c66a400c1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.941981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1be2-d173-4dac-aaf8-29b7db8fefb1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:37.968816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.969460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.969792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.977804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.977804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.977804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.983936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:37.985621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:37.986158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:37.986681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:37.988225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:37.989759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:37.991649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 42/89] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:37.992439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:38.013265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:38.094556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 48/90] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:37 2022] POST /identity/v3/users => generated 289 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:38.095304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:38.129064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b469fae-28a2-42f4-8182-c8814c3cfde2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:38.196855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:38.197783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:38.198097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:38.198578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:38.199962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:38.203593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:38.209002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 43/91] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:37 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:38.210215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:38.327720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2715-bf07-4b39-901c-0cd3e9e1c54d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:38.346474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:38.359814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:38.366980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d26e5-f79a-4a61-8542-0fcda6c46b31 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:38.394929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:38.395608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:38.395901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:38.396181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:38.399277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:38.403094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:38.406057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 49/92] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:38 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:38.407795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:38.436121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:38.436764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:38.437050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:38.437322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:38.438164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=f199c9c45ff44aa0a14a3b7dc647ab4c) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:38.438480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:38.439977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:38.448686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 44/93] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:38 2022] GET /identity/v3/role_assignments?user.id=f199c9c45ff44aa0a14a3b7dc647ab4c&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:38.449247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:38.566991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b9303-218b-4ed6-ace5-710b14426397 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:38.602209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122049-a31d-4f81-9cb1-9da3a1aa4b8f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:38.638612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:38.639665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:38.640113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:38.640536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:38.642073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:38.642631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:38.644461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:38.661038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 50/94] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:38 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:38.677383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:38.678070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:38.678358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:38.678633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:38.702951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:38.796871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:38.798470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:38.945896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 45/95] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:38.953361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:39.018865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:39.080749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e8800-d700-4fb5-aa58-aa6ed1656162 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:39.133404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:39.134107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:39.134394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:39.134672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] PATH_INFO: `/v3/projects/a9e98587d9284c1dbf18c7785e213a9f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:39.136529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] RBAC: Authorizing `identity:get_project(project_id=a9e98587d9284c1dbf18c7785e213a9f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:39.138232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ca03-4e2b-4089-89de-19d085062765 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:39.139999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 51/96] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:38 2022] GET /identity/v3/projects/a9e98587d9284c1dbf18c7785e213a9f => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:39.146113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:39.226431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:39.285798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078860-d531-40fc-9d7c-1a53ee5e73d0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:39.335828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:39.336476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:39.336768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:39.337053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:39.337910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=a9e98587d9284c1dbf18c7785e213a9f, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:39.338897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:39.340491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9e216-ed2e-4fc7-8532-09c0e734ac0d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:39.347207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 46/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:39 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=a9e98587d9284c1dbf18c7785e213a9f&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:40.679506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dad6-3f8c-4420-abf3-349a98dfdbba None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:40.680185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dad6-3f8c-4420-abf3-349a98dfdbba None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:40.680185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860dad6-3f8c-4420-abf3-349a98dfdbba None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:40.681598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 52/98] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:40.695986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:40.696488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:40.696754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:40.722886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:40.724124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:40.827513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 47/99] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:40.863602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860dad6-3f8c-4420-abf3-349a98dfdbba None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:40.999533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860dad6-3f8c-4420-abf3-349a98dfdbba None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.022280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:41.045543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.046282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.046584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.046874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.062755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:41.067766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:41.068600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:41.069372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 53/100] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:41.076601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.135889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:41.212884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35f6e7-504d-46ef-9234-3142fc18ba7c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.259740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.261024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.261577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.262088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.263028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:41.263558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:41.265174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52059f-c615-4e70-8593-02912b9761e3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:41.279112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 48/101] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:41.290910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.413248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b443de-b0e3-4e52-9471-945741ec7d55 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.413953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b443de-b0e3-4e52-9471-945741ec7d55 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.414443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b443de-b0e3-4e52-9471-945741ec7d55 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.416015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 49/102] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:41.422457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e68-1a4e-43d2-8300-dc67c7082e62 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.423023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e68-1a4e-43d2-8300-dc67c7082e62 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.423526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a14e68-1a4e-43d2-8300-dc67c7082e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.430708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea604a-c301-40da-8bb4-16ba2302cf56 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.445291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-35a14e68-1a4e-43d2-8300-dc67c7082e62 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:41.447270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-35a14e68-1a4e-43d2-8300-dc67c7082e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:41.527368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 50/103] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:41.527978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.528718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.529017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.533774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.533774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:41.533774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce9b8-c2ab-484a-8162-cb0b65d20e89 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:41.534597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcef71-2cfb-46ef-ac68-764b289b3881 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.535090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcef71-2cfb-46ef-ac68-764b289b3881 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.535566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcef71-2cfb-46ef-ac68-764b289b3881 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.538135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 54/104] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:41 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:41.538580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 51/105] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:41.543180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edf24-7c06-4454-a108-f555008feb5e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.543479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edf24-7c06-4454-a108-f555008feb5e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.543828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edf24-7c06-4454-a108-f555008feb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.545335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcef71-2cfb-46ef-ac68-764b289b3881 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.590026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-270edf24-7c06-4454-a108-f555008feb5e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:41.590026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-270edf24-7c06-4454-a108-f555008feb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:41.626828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:41.650237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:41.661712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 55/106] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:41.662731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edf24-7c06-4454-a108-f555008feb5e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.753391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcef71-2cfb-46ef-ac68-764b289b3881 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.795752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.796148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.796597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.796888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.798165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:41.799776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:41.801534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 52/107] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:41 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:41.802419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.868444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edf24-7c06-4454-a108-f555008feb5e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.910047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.911071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.911576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.912048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.925936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-58438cd3-e2c3-45df-8ef8-6d530fc052ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:41.932610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:41.933490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:41.934288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:41.938062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 56/108] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:41.940884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a4e1-dacf-4681-b5ca-81ac88764286 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.941331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542417a-7dbc-4441-b5db-650e5e67fe5b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:41.941677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a4e1-dacf-4681-b5ca-81ac88764286 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.942459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284a4e1-dacf-4681-b5ca-81ac88764286 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.943464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:41.945976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 57/109] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:41.947171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284a4e1-dacf-4681-b5ca-81ac88764286 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:41.987025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:41.987705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:41.987994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:41.988270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:41.998666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.001940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:42.007346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:42.011993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 53/110] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:42.012763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.087011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284a4e1-dacf-4681-b5ca-81ac88764286 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.127005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.127889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.128266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.128701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/d073dc9750f945a8aad22251b28e5c20/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.129356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c568e5-adad-4979-90a7-c22daae57f5f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.130813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, user_id=d073dc9750f945a8aad22251b28e5c20, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.133029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.170758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.171700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.172193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.172717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.174281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:42.175086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.178009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31bfa-9ef3-44dd-bc18-f3376b028c37 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.189793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 54/111] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:42.191346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.191805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.192247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.217507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 58/112] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:41 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/d073dc9750f945a8aad22251b28e5c20/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:42.220241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:42.222270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:42.223816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.259332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.362467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 55/113] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:42.363458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.400211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.416877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f43983-7f3f-4910-96cd-3d4324a236c7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.465590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.466323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.466623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.467247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.468255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:42.468806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.470873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3766d5-4ebe-4b12-8f4b-c765f224e2c6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.483325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 59/114] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:42.484670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c42d-b1f8-42ba-b570-6ae7ce4c0f23 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.485046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c42d-b1f8-42ba-b570-6ae7ce4c0f23 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.485408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977c42d-b1f8-42ba-b570-6ae7ce4c0f23 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.487799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 60/115] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:42.493020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c42d-b1f8-42ba-b570-6ae7ce4c0f23 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.520492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e20f0-3094-4ef8-8794-437c641cecb9 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.560519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.561282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.561574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.561901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] PATH_INFO: `/v3/users/37d6100019a9426f98a51011ea411ab2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.581155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=37d6100019a9426f98a51011ea411ab2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.582921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36d665-f9d0-4ec9-bb4a-44a9c55f4dd8 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.584748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 56/116] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/users/37d6100019a9426f98a51011ea411ab2 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:42.593818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138646-ac65-453d-80a8-0c51f157b71f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.593818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138646-ac65-453d-80a8-0c51f157b71f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.593818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35138646-ac65-453d-80a8-0c51f157b71f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.593818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 57/117] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:42.593818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138646-ac65-453d-80a8-0c51f157b71f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.610274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.628439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977c42d-b1f8-42ba-b570-6ae7ce4c0f23 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.680756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.681429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.681825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.682425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.684190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.686160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216797bd-f3f1-4f94-8b3e-5f7442e5d0f9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.692764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 61/118] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:42.692764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d45d-b8f3-4fbd-903a-555cde0f75ec None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.692764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d45d-b8f3-4fbd-903a-555cde0f75ec None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.692764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d45d-b8f3-4fbd-903a-555cde0f75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.711772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4132d45d-b8f3-4fbd-903a-555cde0f75ec None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:42.716022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4132d45d-b8f3-4fbd-903a-555cde0f75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:42.720722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35138646-ac65-453d-80a8-0c51f157b71f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.744165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.767628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.767628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.768182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.768182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.769311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:42.771402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:42.779237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 58/119] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:42.779237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.813013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 62/120] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:42.823960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.824550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.825317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:42.853132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:42.854472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:42.904768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:42.927288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6bb28-16b4-43db-a080-90975bdc5a03 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:42.961361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 63/121] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:42.962590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:42.981128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:42.982202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:42.982966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:42.983874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.064066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.079955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.081447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:43.082722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04f53a-b49b-45a9-9142-358c2ac2feed None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.129906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.130723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.131183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.131655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.132461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.134275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:43.190837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.211462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 59/122] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:43.212317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.231272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 64/123] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:00:42 2022] POST /identity/v3/projects => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:43.238931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.375183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0cc5a-8f90-41a8-9072-feac66bdf2bc None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.390608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf702d-445a-41d3-b15d-08fc5dd26477 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.422039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.422716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.423012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.423299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.424601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.426110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:43.428193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 60/124] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:43.429140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.443096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.444483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.445250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.445851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.455773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.461197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:43.467432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:43.479516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 65/125] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:43.481128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.500288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.580922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742201d2-3b21-47bf-a0f3-1efb8b2dd5c7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.612073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44363e-1098-442f-b766-5f5bd69cbc2f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.624016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.625064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.625638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.626289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.645341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:43.652439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.653375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.653842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.654418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.655855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:43.656321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:43.657420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:43.658298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:43.658891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 61/126] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:43.659468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:43.659663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.661346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 66/127] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:43.663162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.787124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.833073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750942-4857-48f5-98b1-d021b5b798ba None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.837916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391c8a-0530-4a8b-b907-e7f50f1b96b5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:43.846971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:43.879812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.880454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.880746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.881033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.881787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:43.882111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.883576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:43.885884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:43.887679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:43.888341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:43.888998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/f199c9c45ff44aa0a14a3b7dc647ab4c/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:43.893050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, user_id=f199c9c45ff44aa0a14a3b7dc647ab4c, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:43.893718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 67/128] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:43.894842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:43.895671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.002727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 62/129] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:43 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/f199c9c45ff44aa0a14a3b7dc647ab4c/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:44.014370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.022381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965efa2d-1b74-4d33-8639-0449c0131d29 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.086617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:44.097619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.098288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.098579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.098861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.099629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:44.099910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.101466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.112398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 68/130] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:44.118235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.259107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f8de-489a-4110-a348-788df8d5fcf3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.261032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d07e3a-0520-4bf3-ad11-1018ee0a6a44 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.306960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.307394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.308041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.308332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.308616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.308878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.309370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.309482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=37d6100019a9426f98a51011ea411ab2) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:44.309730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.310232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.311254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.311928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.314020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.316758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 69/131] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:44 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:44.317660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 63/132] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:44 2022] GET /identity/v3/role_assignments?user.id=37d6100019a9426f98a51011ea411ab2&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:44.318084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.324275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.382354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:44.450316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:44.468159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4c77e-57bf-4838-b2a4-13b8be6044ce None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.515529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.516934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.517921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.518854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.521433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.523686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.524081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16392617-a4e8-420a-883b-45c10f50e422 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.526074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 64/133] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:44 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:44.541335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.614366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.615028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.615318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.615603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.616804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.618478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.620936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 70/134] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:44 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:44.626559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.714311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:44.717339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159967b3-b062-41af-abb0-6fec85a287ac None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.747990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c24a0-e209-4d0d-859e-59a7c98dc2b5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:44.763900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.767694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.768205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.768693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/d073dc9750f945a8aad22251b28e5c20/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.771683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, user_id=d073dc9750f945a8aad22251b28e5c20, role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.773622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d7f8-5c12-42e4-b8c5-93ae838dddf7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.806591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:44.817816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:44.818820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.819381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.819879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] PATH_INFO: `/v3/projects/a9e98587d9284c1dbf18c7785e213a9f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.821376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] RBAC: Authorizing `identity:get_project(project_id=a9e98587d9284c1dbf18c7785e213a9f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:44.824014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adfd06-a64a-45ac-a873-b2025aafdffd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:44.825960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 71/135] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:44 2022] GET /identity/v3/projects/a9e98587d9284c1dbf18c7785e213a9f => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:44.827513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc4ff-33d6-42ed-8fa8-9d3bd5145ca4 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.828181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc4ff-33d6-42ed-8fa8-9d3bd5145ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.828667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc4ff-33d6-42ed-8fa8-9d3bd5145ca4 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.830205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 72/136] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:44.831899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc4ff-33d6-42ed-8fa8-9d3bd5145ca4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:44.905260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 65/137] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:44 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/d073dc9750f945a8aad22251b28e5c20/roles/b43b05a5c1b8468d880c67404b4f733e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:44.907332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:44.908109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:44.910034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:44.950466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:44.957564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:45.012915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc4ff-33d6-42ed-8fa8-9d3bd5145ca4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:45.085340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:45.086239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.086407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.086658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] PATH_INFO: `/v3/projects/a9e98587d9284c1dbf18c7785e213a9f/users/d073dc9750f945a8aad22251b28e5c20/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.094526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a9e98587d9284c1dbf18c7785e213a9f, user_id=d073dc9750f945a8aad22251b28e5c20, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:45.096260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:45.116181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 66/138] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:45.168798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:45.185658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:44 2022] PUT /identity/v3/projects/a9e98587d9284c1dbf18c7785e213a9f/users/d073dc9750f945a8aad22251b28e5c20/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:45.294365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:45.308114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb66163-995d-43e3-91a1-1d510e548baa None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:45.350649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:45.351318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.351611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.351901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.364997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:45.370518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:45.371402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:45.372202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:45.378970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:45.469054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:45.545823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfde2d9-a3f7-48c1-aaa4-67238e4726ba None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:45.594530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:45.595189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.595522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.595805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.596553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:45.596858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:45.598354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:45.609251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 74/141] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:45.615077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:45.739955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d89b9-a82c-41d5-afa6-90b900edfe94 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:45.782020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:45.782689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.782974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.783252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.784597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:45.786124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fd7a8-35fc-439d-afe4-689dc9e3a7ff None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:45.787751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 68/142] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:45 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:45.794488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:45.967312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb4e3-d970-4454-9696-74232047210a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.968117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb4e3-d970-4454-9696-74232047210a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.968117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeb4e3-d970-4454-9696-74232047210a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.969224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 69/143] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:45.979996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:45.980292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:45.980568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:45.995888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd09083-92e7-47a4-91d2-4cc3b1aa143b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:46.016577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:46.017975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:46.024356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:46.061041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:46.078551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:46.079198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:46.079488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:46.079757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:46.238274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 70/144] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:46.253500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:46.255039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:46.295240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:46.450044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 75/145] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:46.456558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:46.496087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:46.577717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567526d-f1c8-44d2-931c-a74425ca20ae None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:46.649215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470f7d4-0b6d-4da7-8c16-b458db6980fb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:46.671737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:46.672519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:46.673255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:46.673255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:46.674798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:46.676361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:46.678918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 71/146] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:46.687273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:46.704514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:46.705182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:46.705464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:46.705810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:46.708823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:46.710346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:46.713905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 76/147] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:46 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:46.722912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:46.734136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:46.904952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:46.919520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f1531-9c73-4e58-8c77-9804d4ec41e6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:46.946798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4792d6a-2b97-47d2-b640-c354d4528ec1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:46.989494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:46.990349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:46.990644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:46.990923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:46.991887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:46.992236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:46.993992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557befbe-c630-45d3-b0df-8c876cc3361d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:47.002405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 77/148] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:46 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:47.013961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:47.014619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:47.014911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:47.015369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:47.016095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:47.017662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8477-352d-4420-9e23-5242dabf0659 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:47.137128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 72/149] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:46 2022] POST /identity/v3/users => generated 283 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:47.492433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438071b-9fff-47a4-824f-3b6bebbf63df None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:47.492951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438071b-9fff-47a4-824f-3b6bebbf63df None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:47.493032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438071b-9fff-47a4-824f-3b6bebbf63df None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:47.494718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 78/150] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:47.500538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:47.500992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:47.501276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:47.525981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:47.527203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:47.620702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 73/151] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:47.643902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438071b-9fff-47a4-824f-3b6bebbf63df None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:47.801599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438071b-9fff-47a4-824f-3b6bebbf63df None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:47.844385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:47.845473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:47.845996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:47.846524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:47.860356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-52524f0a-1a61-4c24-9569-d20fda978f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:47.866177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:47.867045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:47.867832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:47.875973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 79/152] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:47.877658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:47.880069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:47.998794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b6b3-5119-401b-bf97-c36330ac1d9c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:47.999126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b6b3-5119-401b-bf97-c36330ac1d9c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:47.999472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b6b3-5119-401b-bf97-c36330ac1d9c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.001095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 80/153] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:48.009166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc75b-41fa-4c27-9de8-14264452237d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.009338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.009536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.013444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.050223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:48.051440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:48.053966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.069865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.071385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.071385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.071385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.072198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:48.073271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:48.075029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:48.084709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 74/154] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:48.091035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.149306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 81/155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:48.160808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.175712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.223920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28234e-385a-4ec5-a515-8eaf753f25e5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.281594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.282467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.282874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.283337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] PATH_INFO: `/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.284870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] RBAC: Authorizing `identity:get_user(user_id=f199c9c45ff44aa0a14a3b7dc647ab4c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:48.286599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d11a-727a-419a-9356-abdac5653bcc None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:48.288436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 75/156] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/users/f199c9c45ff44aa0a14a3b7dc647ab4c => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:48.294674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575390a-c7c2-4608-9bfc-7094c9c130ee None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.295096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575390a-c7c2-4608-9bfc-7094c9c130ee None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.295480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575390a-c7c2-4608-9bfc-7094c9c130ee None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.298737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 76/157] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:48.299846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575390a-c7c2-4608-9bfc-7094c9c130ee None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.339333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3065-a4be-4ddb-b200-5614e95d28f8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.388383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.390013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.390592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.391047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.401995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.411838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1e15a6b4-465d-464b-828d-5c7f000f5146 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:48.419022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:48.420351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:48.421494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 82/158] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:48.424534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.424891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.425240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.448737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:48.448737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:48.453588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575390a-c7c2-4608-9bfc-7094c9c130ee None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.502352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.514076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.515062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.515062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.515337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.549645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 83/159] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:48.551265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.624845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:48.626692 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:48.685616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0281-0c14-4e96-ad85-9dbc5a6efbc2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.723132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.744826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.745554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.745870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.746151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.746900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:48.747206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:48.748629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ab498-1c03-49a9-8b5a-e65c244d08f1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:48.761639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 84/160] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:48.761639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395751-ba61-4b53-a66b-52a00b05d057 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.769918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395751-ba61-4b53-a66b-52a00b05d057 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.770334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395751-ba61-4b53-a66b-52a00b05d057 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.771819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 85/161] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:48.772575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17395751-ba61-4b53-a66b-52a00b05d057 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.794369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 77/162] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:48.795693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:48.831764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:48.911658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e205db-4eec-4a63-8267-1f1ae6467327 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:48.949522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:48.950548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.951034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.951531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] PATH_INFO: `/v3/users/37d6100019a9426f98a51011ea411ab2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.952954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] RBAC: Authorizing `identity:get_user(user_id=37d6100019a9426f98a51011ea411ab2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:48.954674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc11d6-6b24-4262-8e36-9b33e203051d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:48.956496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 78/163] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/users/37d6100019a9426f98a51011ea411ab2 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:48.958045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:48.958539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:48.959029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:48.978236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:48.980334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:49.053529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 79/164] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:49.054456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17395751-ba61-4b53-a66b-52a00b05d057 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.055336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.117326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:49.128636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.129308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.129588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.129887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.162297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:49.169707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:49.170639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:49.171456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 86/165] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:49.172224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.279740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e08c-791b-4e02-bfa5-23e1ffe5b354 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.286145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:49.361158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.361837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.362124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.362401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.364233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:49.365690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:49.367627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 80/166] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:49.371447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.373737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a8f0-4f08-4ded-b7cb-e43df5517145 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.448749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.449585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.449976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.450330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.451703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:49.453251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:49.455058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 87/167] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:49.455922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.553191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:49.561058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd64-95f0-4057-912e-3785e04ed479 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.608251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.608915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.609201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.609478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.630026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:49.635095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:49.636321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:49.637193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:49.650219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 81/168] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:49.651972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.672636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05e1b6-bc63-40bf-af03-e8158dbaa336 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.704107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:49.730592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.731254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.731541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.731822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.732575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:49.732973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:49.735037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:49.768935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 88/169] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:49.770459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.885123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c811-220b-4432-bfa5-0341bfd1b432 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.921397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:49.922072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:49.922362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:49.922645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:49.923459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=f199c9c45ff44aa0a14a3b7dc647ab4c) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:49.923777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:49.925392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:49.932110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 82/170] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/role_assignments?user.id=f199c9c45ff44aa0a14a3b7dc647ab4c&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:49.932922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:49.981866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db3d5c-0e76-4de6-997f-38a7a96c19a0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:49.985957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.050802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f458a70-b8c9-438f-b348-615dfd87616e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.054504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.055216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.055510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.055797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/37d6100019a9426f98a51011ea411ab2/roles/7c65eee24ca3485587699dd2b78c54e5` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.058348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, user_id=37d6100019a9426f98a51011ea411ab2, role_id=7c65eee24ca3485587699dd2b78c54e5)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.059976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.092657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.093619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.094124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.094616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.095563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:50.096094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.097771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.107841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 83/171] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:50.109102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:50.138928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 89/172] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:49 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/users/37d6100019a9426f98a51011ea411ab2/roles/7c65eee24ca3485587699dd2b78c54e5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:50.139661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:50.213348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.224798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fafc24-dc36-4686-92c1-bb8ea9b85457 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.225449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.265922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.266601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.266894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.267178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.268543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.270102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.272100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 84/173] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:50.278461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:50.325068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec554dd-a46c-4fa0-a8ed-84fd98a0b9e4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.415314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8e79-0b68-4321-8a8b-f7e08267da1b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.438620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.439312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.439604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.439890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] PATH_INFO: `/v3/users/d073dc9750f945a8aad22251b28e5c20` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.441313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] RBAC: Authorizing `identity:get_user(user_id=d073dc9750f945a8aad22251b28e5c20)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.442853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.444666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 90/174] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/users/d073dc9750f945a8aad22251b28e5c20 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:50.450822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:50.467191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.468082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.468506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.468917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.505859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.562586 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.564090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.682105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 85/175] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:50.688448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:50.751895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.776318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0e51-72f0-4904-a273-f9a75ea4dd7d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.804510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:50.809316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4d9f2-d24e-456f-a36b-fbb5e9974639 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:50.848333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.849001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.849271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.849546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.852900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:50.857382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4c7dd-d876-4522-94b2-220c4732a9a8 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:50.859379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 86/176] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:50.860334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caac3f-4799-4778-a7ae-a7e972a45608 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.860617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caac3f-4799-4778-a7ae-a7e972a45608 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.860891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caac3f-4799-4778-a7ae-a7e972a45608 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.868208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 87/177] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:50.874231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:50.874867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:50.875149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:50.875424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:50.876772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caac3f-4799-4778-a7ae-a7e972a45608 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.038941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caac3f-4799-4778-a7ae-a7e972a45608 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.040921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:51.043384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc0813-5828-4b1c-9ca7-6f9571e51e77 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:51.080899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:51.096877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.097507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.097816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.101861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.101861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:51.101861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:51.101861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555af56-27ae-4f0d-b4ad-2c74d8c3f110 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:51.108924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 88/178] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:51.115198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.115555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.115837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.149978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:51.152821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:51.248720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 91/179] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:00:51.254429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 89/180] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:51.254931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af6f9-f7b0-4b57-9166-98b76fb047b1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.254931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af6f9-f7b0-4b57-9166-98b76fb047b1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.255217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af6f9-f7b0-4b57-9166-98b76fb047b1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.255310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.256867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 92/181] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:51.267438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.267743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.268003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.306464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:51.308778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:51.312963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:51.390911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49faab-fb0e-4766-8924-a88d76144eea None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.408658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:51.412298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:51.413341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.442289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.443664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.443960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.444283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] PATH_INFO: `/v3/projects/a9e98587d9284c1dbf18c7785e213a9f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.445989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] RBAC: Authorizing `identity:get_project(project_id=a9e98587d9284c1dbf18c7785e213a9f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:51.449034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:51.451392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 90/183] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/projects/a9e98587d9284c1dbf18c7785e213a9f => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:51.457910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.562461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e4aa-37de-43df-a9de-60b321be24ac None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.600578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869980-84cf-422d-bce5-53b162ff1066 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.605746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.606472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.606814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.607030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.615573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:51.621641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:51.627491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:51.628632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:51.629590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:51.631622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 94/184] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:51.638230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.643427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.644054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.644333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.644607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.645467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=a9e98587d9284c1dbf18c7785e213a9f, user.id=d073dc9750f945a8aad22251b28e5c20) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:51.645791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:51.647257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eb92-109b-4124-aab4-9919d29ec488 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:51.656364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 91/185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/role_assignments?user.id=d073dc9750f945a8aad22251b28e5c20&scope.project.id=a9e98587d9284c1dbf18c7785e213a9f&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:51.656364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115a0b-dc86-4ac6-a17a-2b58c47c0eac None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.656364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115a0b-dc86-4ac6-a17a-2b58c47c0eac None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.656364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115a0b-dc86-4ac6-a17a-2b58c47c0eac None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.656784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 92/186] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:51.657341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115a0b-dc86-4ac6-a17a-2b58c47c0eac None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.739808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:51.799098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d857a-3746-45ba-8f1b-fe5291cac98d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.834856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115a0b-dc86-4ac6-a17a-2b58c47c0eac None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:51.855816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.855816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.856217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.856217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.873631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1ffc1ea1-bb14-4124-9b7e-a8b019fae872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:51.879266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:51.880278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:51.881225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 95/187] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:51.882114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.882114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.882252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.896831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:51.897656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:51.899127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:51.899415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:51.901662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:51.902043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:51.904011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:51.907710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:51.908911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:51.916907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 93/188] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:51.917962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:51.989161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.005493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 96/189] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:52.012522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.073418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d094782-5c19-497d-8eb3-241763df01ff None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.085727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.124479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.125345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.125877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.126335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.127403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:52.127852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.129882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.136106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187b39-3ff5-4077-9c4f-67fbfa5c82fb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.140408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 94/190] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:00:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:52.141238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.185255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.186328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.186839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.187340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.205023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.206546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.208426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 97/191] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:52.210670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.268668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.273673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c1a4a-e4a4-417d-a9a5-00ff273062fa None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.323888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.324565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.325312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.325312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.326493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.328575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.330462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 95/192] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:52.335520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.344281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea5d6-947f-485f-8065-fc0b5a38118b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.387453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.388112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.388397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.388675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.389780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.390613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.391974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.394312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 98/193] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:52.399445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.465096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4966049-ca76-4b9c-a83a-1af3739a782f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.504870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.505500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.505799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.506075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.531705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f0eda-c511-4a21-9449-00b732cfe326 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.553020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.585922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.586824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.587528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.588959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.589924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.592914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.610263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.612481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361635e9-cae0-4771-ace7-48cc57890827 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.663032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.703162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 99/194] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:52 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:52.704372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.770358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 96/195] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:52.776675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906737-632e-4133-811e-4a2abea3fcc5 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.776990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906737-632e-4133-811e-4a2abea3fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.777268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b906737-632e-4133-811e-4a2abea3fcc5 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.779109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 97/196] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:52.779909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b906737-632e-4133-811e-4a2abea3fcc5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:52.850464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08efa6-154c-4799-b61e-60a1245c65df None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.907233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.907902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.908259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.908474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.933519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b906737-632e-4133-811e-4a2abea3fcc5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:52.963712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:52.984094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:52.985022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.986239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.986239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:52.988404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:52.989710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae59cb6-13d9-4c2d-a28e-9f97ee0ea062 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:52.992059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 98/197] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:52.993843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:52.995623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:52.995925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.008199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.009973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.023748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.025624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:53.027981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:53.126088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 99/198] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:53.127007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.187714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 100/199] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:53.188392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.247013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051130-c114-4a62-8555-2d3466e512c8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.284280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.288836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.289483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.289735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.290032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.290832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8eb55cb20daf45b58117fe3534f31dca) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:53.291193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.293099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.296505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.299876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 100/200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/role_assignments?user.id=8eb55cb20daf45b58117fe3534f31dca&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:53.307077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.356106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656f636-1afa-4622-a554-095352853ca3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.433777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591bf49-c7b0-42aa-91e2-103d8d492708 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.440697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.441446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.441895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.442311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.457867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:53.463506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:53.466035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:53.468099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 101/201] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:53.475515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.476187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.476469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.476744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.478459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.479067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.480451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.482335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 101/202] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:53.488589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.590098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.643005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90088d03-4cd2-4f00-8490-1bd7559b714f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.662700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5948d-ed84-491c-bc15-cf8934db3041 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.700033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.700589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.700871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.701145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.701990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8eb55cb20daf45b58117fe3534f31dca) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:53.702306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.703805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.717860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 102/203] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/role_assignments?user.id=8eb55cb20daf45b58117fe3534f31dca&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:53.721941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.733611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.734301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.734587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.734867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.735636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:53.735942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.737405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.752794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:53.763871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:53.894987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff796a3b-82c8-4865-b90a-e6ff4a83ed3c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:53.927235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:53.934193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:53.934864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:53.941386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:53.941386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] PATH_INFO: `/v3/users/37d6100019a9426f98a51011ea411ab2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:53.941386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] RBAC: Authorizing `identity:get_user(user_id=37d6100019a9426f98a51011ea411ab2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:53.941386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:53.941386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/users/37d6100019a9426f98a51011ea411ab2 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:53.945294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:54.055948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c1fc-15c6-4234-b4f6-3400608adc58 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:54.091884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:54.092516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:54.092803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:54.093080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:54.157117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:54.167507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:54.169002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:54.280552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:54.285983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:54.402928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58edc7-e1fa-4523-9dcc-e62f08afe458 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:54.439442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:54.440101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:54.440384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:54.440664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:54.442171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:54.443632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e3087-4b2d-40d1-9d5d-0aab926b33a4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:54.445574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:54 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:54.451738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:54.554734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:54.564017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009c1f-3dcb-481f-b769-871bd1c9acff None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:54.599518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:54.600145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:54.600428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:54.600707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:54.601509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, scope.project.id=b15ff892e1734aabb3baa55cb43a069d, user.id=37d6100019a9426f98a51011ea411ab2) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:54.601839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:54.603291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c297ec-495c-47b8-93ca-c03881661f43 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:54.614163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:54 2022] GET /identity/v3/role_assignments?user.id=37d6100019a9426f98a51011ea411ab2&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:55.328253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4726-5a82-4b65-b429-335f712fa809 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.328614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4726-5a82-4b65-b429-335f712fa809 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.329154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e4726-5a82-4b65-b429-335f712fa809 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.330759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:55.336517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038969-254b-41f8-a895-34ff729a8ae7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.337036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038969-254b-41f8-a895-34ff729a8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.337114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038969-254b-41f8-a895-34ff729a8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.357721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a3038969-254b-41f8-a895-34ff729a8ae7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:55.359375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a3038969-254b-41f8-a895-34ff729a8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:55.435965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:55.460066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4726-5a82-4b65-b429-335f712fa809 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:55.544514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:55.581234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e4726-5a82-4b65-b429-335f712fa809 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:55.614102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb11d-09e9-4348-a525-106d4bbb0f63 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.615024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb11d-09e9-4348-a525-106d4bbb0f63 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.615843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb11d-09e9-4348-a525-106d4bbb0f63 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.617390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:55.622308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:55.623294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.623578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.623857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.624190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e401-86b2-4f41-a74f-bfb0856e5aa8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.624671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e401-86b2-4f41-a74f-bfb0856e5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.625044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:55.625345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e401-86b2-4f41-a74f-bfb0856e5aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.626537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:55.629809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 106/212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:55.634075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:55.647484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1dd6e401-86b2-4f41-a74f-bfb0856e5aa8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:55.649009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1dd6e401-86b2-4f41-a74f-bfb0856e5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:55.739439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 107/213] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:55.741160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06baa88-768e-4103-bb49-20b3f59cf800 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.741511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06baa88-768e-4103-bb49-20b3f59cf800 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.741958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06baa88-768e-4103-bb49-20b3f59cf800 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.743430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 108/214] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:55.749558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.750159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.750634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.775730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301e17-8105-4cbe-9139-c515617856f1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:55.776555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:55.777778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:55.792835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:55.815925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:55.816544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:55.816878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:55.817165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:55.817886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:55.819339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:55.829108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:55.864416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 109/215] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:55.865307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:55.940257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 107/216] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:55 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:55.941563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:55.994162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28067-4fe5-4354-891b-63151c3bd114 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.046536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.048132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.048896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.049351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.064233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:56.069522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:56.070498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:00:56.071301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:56.081000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 110/217] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:56.082566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.098528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.112241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f487e4f-2a6a-4bf5-8f1a-ee01b0d8b473 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.151258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.151854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.152182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.152464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.165030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:56.171421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:56.172477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:56.173271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 108/218] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:56.183391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.228173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799a8b-3515-4a65-988c-48ddbd758401 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.252739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.273968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.274678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.275052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.275372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.276115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:56.276461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.278528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.292050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 111/219] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:56.297022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.325104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02815-54a9-4773-914f-837efd0c8166 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.368102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91783f40-345a-4459-a125-c061be533834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.368733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91783f40-345a-4459-a125-c061be533834 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.369740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91783f40-345a-4459-a125-c061be533834 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.370069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91783f40-345a-4459-a125-c061be533834 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.370809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91783f40-345a-4459-a125-c061be533834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:56.371115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91783f40-345a-4459-a125-c061be533834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.372597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91783f40-345a-4459-a125-c061be533834 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.383165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 109/220] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:56.389902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91783f40-345a-4459-a125-c061be533834 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.396099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.441694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b8a63-f397-41e9-ab7f-e6865deef5bb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.489236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.490244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.490702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.491149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] PATH_INFO: `/v3/users/3b111565b0a94763befc5a32d9e90094` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.509291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] RBAC: Authorizing `identity:get_user(user_id=3b111565b0a94763befc5a32d9e90094)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.511789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366013a4-fa57-4af1-bdbf-533b4bd784ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.513056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91783f40-345a-4459-a125-c061be533834 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.514270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 112/221] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/users/3b111565b0a94763befc5a32d9e90094 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:56.520237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7933-dfd6-453b-8537-2ba07475c6c7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.520749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7933-dfd6-453b-8537-2ba07475c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.521222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7933-dfd6-453b-8537-2ba07475c6c7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.523490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 113/222] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:56.524524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7933-dfd6-453b-8537-2ba07475c6c7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.529720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.559757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.560429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.560716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.560994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.562972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.564789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3d1e2-fdef-4ced-887f-a213c3f4dc4c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.566808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 110/223] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:56.574549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.575035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.575513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.601046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:56.602766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:56.651201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7933-dfd6-453b-8537-2ba07475c6c7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.681956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.691604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.692627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.693124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.693593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.703818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 111/224] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:56.704528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.781327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.784684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.838395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a154c7-414b-4c56-9e39-84ba1345320a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:56.856834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:56.886451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:56.887620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:56.887910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:56.888191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:56.889696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:56.891878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:56.897835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 112/225] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:56.898744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.924873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 114/226] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:56.925774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:56.959807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:57.024731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09fc-fc30-45ee-9c88-9238c6299068 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.059982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacbb1e-cb04-4edf-896e-098d0bf820d2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.077613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.078950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.079447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.080295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.096313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:57.097983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.098736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.099135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.099486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8eb55cb20daf45b58117fe3534f31dca/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.101571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, user_id=8eb55cb20daf45b58117fe3534f31dca, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:57.102626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:57.103630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:00:57.104674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:00:57.105278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.108054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 113/227] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:00:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:00:57.109288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.156278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:57.189787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 115/228] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:56 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8eb55cb20daf45b58117fe3534f31dca/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:57.189787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.258743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899f84-1a41-447e-ae9b-7a68562ab481 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.295006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:57.314098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb34cc4-51ea-49b2-905f-8d7e406638f0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.351741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.352980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.353507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.353969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.357672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.358638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.358757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.359119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.359574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.360470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:57.360850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.361108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.363006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 114/229] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:57 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:57.368042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.370039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.381791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 116/230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:00:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:57.388742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.540522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8960b-ed0d-4639-b9c7-2da6b4e49e2c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.551471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:57.558920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb35bc-080c-4830-a00d-2115a3e60e35 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.579293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.579929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.580215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.580494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.581294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=3b111565b0a94763befc5a32d9e90094) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:57.581612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.583108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.590367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 115/231] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:00:57 2022] GET /identity/v3/role_assignments?user.id=3b111565b0a94763befc5a32d9e90094&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:57.601995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.602768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.603052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.603366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.605244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.608026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.610132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 117/232] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:57 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:00:57.615940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.728987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c73d9-49b1-4b39-a857-af7627bf4228 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.769531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.770246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.770531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.770808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.772022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.773482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd6eb4-b6b3-405c-bb7d-c57d28f29116 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:57.776274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 116/233] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:57 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:57.782049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:57.814343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:57.940742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c70f-e5b9-4fb5-90fa-219739c1d347 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:57.986360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:57.987078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:57.987366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:57.987644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8eb55cb20daf45b58117fe3534f31dca/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:57.992191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, user_id=8eb55cb20daf45b58117fe3534f31dca, role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:57.993695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8eb72-0607-4381-9b5d-dd6058b69fa2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:58.102597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 118/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:00:57 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8eb55cb20daf45b58117fe3534f31dca/roles/b43b05a5c1b8468d880c67404b4f733e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:00:58.515010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368234e-8960-4d54-b5b9-259fe39e7279 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:58.515422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368234e-8960-4d54-b5b9-259fe39e7279 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:58.515632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368234e-8960-4d54-b5b9-259fe39e7279 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:58.516878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 117/235] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:00:58.524095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:58.524446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:58.524645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:58.554777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:58.556047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:58.570576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8168cf-f03c-4174-aa52-2872f04fd0a6 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:58.571205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8168cf-f03c-4174-aa52-2872f04fd0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:58.571362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8168cf-f03c-4174-aa52-2872f04fd0a6 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:58.573293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 118/236] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:58.578658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:58.578948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:58.579233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:58.598225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:58.599465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:58.649879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:58.679729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 119/237] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:00:58.683007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 119/238] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:00:58.704917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:58.736002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:58.750669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:58.822836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba99bd3-01ec-41ee-9b37-3b0b09a9c1ef None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:58.866181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:58.867211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:58.867505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:58.867786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:58.869024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:58.870922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:58.872831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 120/239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:58.878337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:58.924068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:58.995810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce87f8-eefb-4d1d-95a9-eee5bf925c03 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:59.018639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdfdfe-e14b-4fd8-a7bc-4de6c41ce686 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:59.039568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:59.040316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.040914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.041270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.042623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:59.044224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:59.073391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:59.074148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.074439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.074719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.085983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:00:59.091977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:00:59.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:00:59.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 120/240] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:00:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:00:59.101783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:59.165114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 121/241] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:00:58 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:00:59.187999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:59.231567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340a17-eb6a-4c7d-9d0e-432afc5fa6ce None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:59.269953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:59.270520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.270806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.271149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.272022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:00:59.272459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:59.274144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:59.285343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 121/242] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:00:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:59.291177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:59.407796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:59.421946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7af9f-dd6d-45b9-8089-25c911c7b4e3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:59.469947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:59.470619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.470979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.471264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] PATH_INFO: `/v3/users/8c962aba6b2641a5ad7a4ecd9b937781` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.487294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] RBAC: Authorizing `identity:get_user(user_id=8c962aba6b2641a5ad7a4ecd9b937781)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:59.488927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:59.490603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 122/243] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:00:59 2022] GET /identity/v3/users/8c962aba6b2641a5ad7a4ecd9b937781 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:00:59.496898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:59.620156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a0013-74f1-417e-94fb-84673d6e0b29 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:00:59.649244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:00:59.659479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:00:59.664671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.664671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.664671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.760042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:00:59.762640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d48258-1a38-4322-b065-7256e76c70a2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:00:59.888817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 122/244] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:00:59.894069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:00:59.924304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca3eb-00ec-4bd4-85e5-8e3607f8c2d1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.924628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca3eb-00ec-4bd4-85e5-8e3607f8c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.924865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca3eb-00ec-4bd4-85e5-8e3607f8c2d1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.926254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 123/245] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:00:59.932895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:00:59.933507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:00:59.934011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:00:59.959245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:00:59.959463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:00:59.988971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:00.036145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f24b-2888-4a6d-95e3-90f3f7072879 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:00.048015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 124/246] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:00.074513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:00.075179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.075467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.075746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.076946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:00.078551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:00.080584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 123/247] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:00:59 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:00.085217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.085910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.118013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:00.214101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1286-6d55-4bec-b64c-27cbad273a47 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:00.268539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:00.269588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.270111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.270583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.295457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-52cb142f-c4f9-4415-897f-089506a5bf77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:00.303858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:00.304778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:00.305563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:00.308181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 125/248] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:00.318406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538204-ba8f-44ac-84db-fa71489d691c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.318807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538204-ba8f-44ac-84db-fa71489d691c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.319247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538204-ba8f-44ac-84db-fa71489d691c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.321539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 126/249] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:00.322871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538204-ba8f-44ac-84db-fa71489d691c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.348729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85830-e1f3-485c-a899-75798cdd50e5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:00.362005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:00.416815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:00.418111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.418628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.419098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.420095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8c962aba6b2641a5ad7a4ecd9b937781) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:00.420605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:00.422375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054aee8-38ae-4979-8135-1a5542d40742 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:00.448101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 124/250] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/role_assignments?user.id=8c962aba6b2641a5ad7a4ecd9b937781&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:00.449712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.450049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.450384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.457943 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538204-ba8f-44ac-84db-fa71489d691c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:00.502084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:00.502725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.502910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:00.503007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.503286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.504042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:00.504147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:00.504350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:00.505808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:00.516425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 127/251] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:00.523110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.642601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 125/252] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:00.686145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:00.707427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3e6d-e062-4c87-bf47-3d03326ef93d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:00.712193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.730667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:00.858537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:00.859217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:00.859482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:00.859762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:00.861169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:00.862659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:00.864279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 128/253] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:00.871358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:00.961501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789bfbd-ae46-4184-8767-4beb6f3ef41a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.067467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.068061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.068350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.068687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.082777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0dd23-4fb6-4bc0-916c-67c669cd4a2d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.102406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:01.108097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:01.109781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:01.111005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 126/254] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:01.122809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:01.148655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.149298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.149586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.149920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.185629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.222270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.242112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:01.243742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75abdde-a1ca-446c-af46-fd373b7541b4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:01.266611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310d58-7bb9-48a2-b4e6-5414e2ef2319 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.353902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 129/255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:01.355496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03649e-9206-43d9-a22a-8b6b57df9f0d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.355786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03649e-9206-43d9-a22a-8b6b57df9f0d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.356065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03649e-9206-43d9-a22a-8b6b57df9f0d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.357414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 130/256] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:01.358232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.358887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.359221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.359499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.360247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:01.360505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03649e-9206-43d9-a22a-8b6b57df9f0d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:01.360630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:01.362092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb7582-0e43-46e6-bbaa-3c93718a0c96 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:01.381788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 127/257] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:01.383162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.383558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.383943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.418635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.419763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:01.421010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:01.478924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03649e-9206-43d9-a22a-8b6b57df9f0d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.534335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.535505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.535998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.536808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.540707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:01.546553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:01.549359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 131/258] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:01.556201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:01.584504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 128/259] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:01.585868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:01.753880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.754118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f6b63-0025-4102-a3ff-231ecf5ce5ab None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.795772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:01.825511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.826668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.827101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.827541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] PATH_INFO: `/v3/users/3b111565b0a94763befc5a32d9e90094` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.829556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] RBAC: Authorizing `identity:get_user(user_id=3b111565b0a94763befc5a32d9e90094)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:01.831946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a584b-e17a-434d-bf29-7e4896c83944 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:01.832067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:01.835885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 132/260] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/users/3b111565b0a94763befc5a32d9e90094 => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:01.837104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:01.892576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:01.893655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:01.894193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:01.894851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:01.895948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8eb55cb20daf45b58117fe3534f31dca) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:01.896456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:01.898189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:01.912454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 129/261] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/role_assignments?user.id=8eb55cb20daf45b58117fe3534f31dca&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:01.913837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.085032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119f3f-0744-45b6-916e-66eec6d88eca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.157410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.158123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.158408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.158684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.172653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:02.177814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:02.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:02.179958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 133/262] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:02.189700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.196714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04e091-4156-42e8-9f1e-dcabf43d29af None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.261882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:02.268812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:02.272303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.272978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.279627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.279627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.279627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:02.279627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:02.284520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 130/263] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:01 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:02.290151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.384787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4b386-8b6c-418b-af11-f01adab99297 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.457803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.458446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.458785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.459124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.459857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:02.460168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:02.461580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:02.486877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 134/264] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:02.490301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986c9b-d0fc-4835-889c-e462db91fd06 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.493628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.537115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.537839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.538226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.538513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/3b111565b0a94763befc5a32d9e90094/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.543209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, user_id=3b111565b0a94763befc5a32d9e90094, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:02.545300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981b06c-e818-475c-bcc6-381ce6b1e3e4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:02.620923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa52dd-85ee-4f4c-9287-7f65987d8efa None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.633163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:02.669163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.669745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.670059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.670342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] PATH_INFO: `/v3/users/8eb55cb20daf45b58117fe3534f31dca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.671615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] RBAC: Authorizing `identity:get_user(user_id=8eb55cb20daf45b58117fe3534f31dca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:02.673192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d3300-fc7c-44ef-91b4-c8781534f71b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:02.679786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 135/265] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:02 2022] GET /identity/v3/users/8eb55cb20daf45b58117fe3534f31dca => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:02.679786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699fbe-f124-4858-8f8a-e41b094c2cdf None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.679786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699fbe-f124-4858-8f8a-e41b094c2cdf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.679786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699fbe-f124-4858-8f8a-e41b094c2cdf None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.679786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 136/266] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:02.682754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699fbe-f124-4858-8f8a-e41b094c2cdf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.692728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 131/267] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:02 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/3b111565b0a94763befc5a32d9e90094/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:02.699285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70665e-97e2-4dbb-b76a-6f8f7fedcb92 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.700599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70665e-97e2-4dbb-b76a-6f8f7fedcb92 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.701176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70665e-97e2-4dbb-b76a-6f8f7fedcb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.734095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0a70665e-97e2-4dbb-b76a-6f8f7fedcb92 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:02.735339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0a70665e-97e2-4dbb-b76a-6f8f7fedcb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:02.804947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:02.821301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 132/268] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:02.830323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9780-a264-4bfa-8714-1abd21ca0638 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.830668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9780-a264-4bfa-8714-1abd21ca0638 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.830953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9780-a264-4bfa-8714-1abd21ca0638 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.832382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 133/269] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:02.849082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699fbe-f124-4858-8f8a-e41b094c2cdf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:02.851105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.851439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.851682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.874920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:02.876145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:02.918493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:02.919488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:02.919863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:02.920281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:02.965347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:02.966583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:02.982090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.021608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.023378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.096550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293add-33ab-4d05-80b2-f23a7e64b41d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.127560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.152922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.154038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.154396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.154746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.156026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.161985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.161985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 135/272] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:03.161985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.162362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 137/272] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:03.164067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.261427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.290124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee9742-6ab0-456e-8d91-488310d0b92d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.300271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522c4b-f80a-42aa-9aa1-55a89cfc5dc1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.332093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.333152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.333675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.334222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.335621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.337276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.339647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 138/273] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:03.345335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.346033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.347170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.347800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.348371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.364186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:03.375212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:03.376807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:03.378453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:03.382134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 136/274] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:03.383180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.434750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.459687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fa07-c14b-47e0-ab07-500cfaa2832f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.496137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d4b7-14a2-4cfe-a320-17b043658166 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.500634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.501356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.501696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.502071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.502832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.504361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdadad5-f684-4f2f-acc3-71a8c5a468db None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.535040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.535581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.535866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.536144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.536977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8eb55cb20daf45b58117fe3534f31dca) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:03.537285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.538768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.545663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 137/275] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/role_assignments?user.id=8eb55cb20daf45b58117fe3534f31dca&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:03.546505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.620540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.629953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 139/276] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:03 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:03.632365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda48f9-d915-45df-9eb8-d0a0b0a85fdd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.636258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda48f9-d915-45df-9eb8-d0a0b0a85fdd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.637231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda48f9-d915-45df-9eb8-d0a0b0a85fdd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.640066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 140/277] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:03.645703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.646061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.646297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.693709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd7c08-bf63-48e7-a5f7-12742eeefb0d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.694885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:03.696228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:03.708524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:03.739577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.740379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.740771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.741156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:03.742185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:03.742626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:03.744627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:03.755489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 138/278] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:03.764574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.842388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 141/279] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:03.868666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:03.932753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dc13-8985-4225-8e5a-e75165c3a91d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:03.979750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:03.980737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:03.981207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:03.981556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] PATH_INFO: `/v3/users/775d223492d14497a74692f683cb90f4` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.004039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] RBAC: Authorizing `identity:get_user(user_id=775d223492d14497a74692f683cb90f4)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.005596 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:04.008635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 139/280] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/users/775d223492d14497a74692f683cb90f4 => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:04.008781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636292c-54c3-45a9-9709-a11abd7f2801 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.015724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:04.047566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:04.054781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.055852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.056146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.057141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.062391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:04.076727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:04.082241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:04.083145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:04.084007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:04.086476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 142/281] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:04.097115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:04.167883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00454-9569-4c89-b3aa-62673d451f22 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.215510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.216502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.216963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.217407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.218427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, user.id=775d223492d14497a74692f683cb90f4, scope.system=all) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:04.218801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.220307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:04.225957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 140/282] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Aug 1 14:01:04 2022] GET /identity/v3/role_assignments?user.id=775d223492d14497a74692f683cb90f4&scope.system=all&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:04.238415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446aa5-848b-48bd-9b66-76578d020121 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.309762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.310435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.310721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.311002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.311750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:04.312058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.313486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:04.324169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 143/283] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:04.329973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:04.471973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:04.480058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56119e-a69e-4b83-9547-073596a66995 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.538810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.539473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.539759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.540035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] PATH_INFO: `/v3/users/8c962aba6b2641a5ad7a4ecd9b937781` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.542534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=8c962aba6b2641a5ad7a4ecd9b937781)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.544209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:04.546154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 141/284] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:04 2022] GET /identity/v3/users/8c962aba6b2641a5ad7a4ecd9b937781 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:04.552041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:04.640652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:04.707295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794805-f6c7-442d-aaa2-e31f36680bc6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.743457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.744579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.744904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.745190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.746539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.747992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb721e9-c6c9-46fb-9c70-81a185413601 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:04.750108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 144/285] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:04 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:04.755740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:04.904384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092fd64-bfbd-4c48-900d-2383a5551cb6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:04.941886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:04.942957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:04.943436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:04.943902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8c962aba6b2641a5ad7a4ecd9b937781/roles/7c65eee24ca3485587699dd2b78c54e5` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:04.946111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, user_id=8c962aba6b2641a5ad7a4ecd9b937781, role_id=7c65eee24ca3485587699dd2b78c54e5)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:04.948622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b226a-f1ba-49aa-b146-7611c755167e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:05.030917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 142/286] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:04 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/users/8c962aba6b2641a5ad7a4ecd9b937781/roles/7c65eee24ca3485587699dd2b78c54e5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:05.256192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7fd2-115f-4bd4-bcce-8657ac14e270 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:05.256743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7fd2-115f-4bd4-bcce-8657ac14e270 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:05.256743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7fd2-115f-4bd4-bcce-8657ac14e270 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:05.258534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 145/287] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:05.264318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:05.264908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:05.265409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:05.285184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:05.286728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:05.307830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:05.365919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 143/288] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:05.388092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7fd2-115f-4bd4-bcce-8657ac14e270 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:05.521681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7fd2-115f-4bd4-bcce-8657ac14e270 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:05.545073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:05.569377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:05.570056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:05.570342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:05.570624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:05.598728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:05.605231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:05.606623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:05.608716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 146/289] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:05.618041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:05.778489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ec73-ae93-4ea0-ab9b-93aefa26f493 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:05.831106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:05.831660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:05.831948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:05.832226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:05.832975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:05.833287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:05.834802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:05.850116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 144/290] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:05.855863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:06.022043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234bf1-30bd-4516-8b11-0ce6ad0d2dfa None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:06.080375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:06.081052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.081394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.081627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] PATH_INFO: `/v3/users/3b111565b0a94763befc5a32d9e90094` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.082882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3b111565b0a94763befc5a32d9e90094)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:06.084350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:06.086313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 147/291] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:05 2022] GET /identity/v3/users/3b111565b0a94763befc5a32d9e90094 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:06.092686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:06.126127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:06.261351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b0421-71ea-49ff-b12e-a3f09937701d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:06.307210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:06.307850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.308136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.308417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.398080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:06.400410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0657c-8e70-484e-b36d-84690a25c159 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:06.426169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:06.517857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 145/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:06.520298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:06.532210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6b589-c563-48fe-8d8f-88e0ed999d6a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.532566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6b589-c563-48fe-8d8f-88e0ed999d6a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.532790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6b589-c563-48fe-8d8f-88e0ed999d6a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.535829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 146/293] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:06.541330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2734f-2899-466f-91ad-9ed903844d94 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.541627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2734f-2899-466f-91ad-9ed903844d94 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.541947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2734f-2899-466f-91ad-9ed903844d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.574838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-27c2734f-2899-466f-91ad-9ed903844d94 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:06.576052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-27c2734f-2899-466f-91ad-9ed903844d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:06.595656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:06.659108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ee78-1eb4-46be-a685-2279525d14b4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:06.707757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:06.708424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.708727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.709001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.710224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:06.711729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196de0-b7c4-41ee-9593-0bf885d6f18f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:06.714169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 148/294] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:06 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:06.715173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f6ba0-30a8-45a2-8890-3d1770fa9747 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.715487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f6ba0-30a8-45a2-8890-3d1770fa9747 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.715730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f6ba0-30a8-45a2-8890-3d1770fa9747 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.720843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 149/295] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:06.721649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f6ba0-30a8-45a2-8890-3d1770fa9747 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:06.727570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 147/296] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:06.727838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.728356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.728858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.747358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:06.749216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:06.850474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:06.886368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 148/297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:06.888014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:06.930226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f6ba0-30a8-45a2-8890-3d1770fa9747 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:06.945432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:06.967933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:06.968483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:06.968770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:06.969050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:06.969887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=3b111565b0a94763befc5a32d9e90094) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:06.970200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:06.971658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:06.978151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 150/298] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:06 2022] GET /identity/v3/role_assignments?user.id=3b111565b0a94763befc5a32d9e90094&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:06.979777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.003749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155cdb0-b375-45a4-8a91-97da243775a5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.046354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.046816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.047257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.060603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9a1b478d-0d7e-4ec2-9d41-1922cb46d4c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:07.066334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:07.067445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:07.068429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:07.070714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 149/299] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:07.072310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0fee-8f90-4a4b-8f75-a11e0e06faf6 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.072896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0fee-8f90-4a4b-8f75-a11e0e06faf6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.073363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0fee-8f90-4a4b-8f75-a11e0e06faf6 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.075623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 150/300] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:07.082243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.082896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.083502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.106136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:07.107857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:07.109891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca87546-dc48-4a3d-967e-c7664746f474 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.148971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.149690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.150593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.150921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.152179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.153685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.155744 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 151/301] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:07.156577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.165605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.198581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 151/302] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:07.199832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.221825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.296108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3d9e-3369-4761-8abf-0e2679269e32 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.339591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.340224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.340514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.340756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb831-15e2-4ff0-97e1-b301769534cb None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.340899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.341506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:07.341848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.344548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.355785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 152/303] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:07.356637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.386347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.387073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.387354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.387633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] PATH_INFO: `/v3/groups` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.388298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.389784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.466447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cae9-f705-4fa3-93f6-9bdc6c63a7ac None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.468012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 152/304] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Aug 1 14:01:07 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:07.468749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.490770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.511309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.525441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.526994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.526994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.526994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.539799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:07.545837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:07.547154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:07.548132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 153/305] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:07.555023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.616423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0a5d8-41d4-4292-9be4-3b9397ce994c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.662393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.663164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.663521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.663874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] PATH_INFO: `/v3/users/eaeeaea0ac0746b5892e1302f12ee73a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.678375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c211f-a5da-4a8f-87b1-b97b3807ba2d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.680021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] RBAC: Authorizing `identity:get_user(user_id=eaeeaea0ac0746b5892e1302f12ee73a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.681666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cc08-5c6d-41bb-a88a-4654fc32c67b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.683393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 153/306] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/users/eaeeaea0ac0746b5892e1302f12ee73a => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:07.684584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e66e1-4c5d-40b8-a8e8-94004cbb3f48 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.684869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e66e1-4c5d-40b8-a8e8-94004cbb3f48 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.685144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e66e1-4c5d-40b8-a8e8-94004cbb3f48 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.686519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 154/307] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:07.690755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e66e1-4c5d-40b8-a8e8-94004cbb3f48 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.717566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.717566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.717566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.717962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.718498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:07.718721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.720109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42ed8-4407-42e0-8299-8ff662df5729 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.730012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 154/308] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:07.734540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.734540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.734540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.752373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:07.753621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:07.784839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.802017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:07.830663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e66e1-4c5d-40b8-a8e8-94004cbb3f48 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:07.850125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 155/309] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:07.850125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:07.892464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:07.893331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:07.893782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:07.894230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:07.895166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, user.id=eaeeaea0ac0746b5892e1302f12ee73a, scope.system=all) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:07.895631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:07.897072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:07.907778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 155/310] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/role_assignments?user.id=eaeeaea0ac0746b5892e1302f12ee73a&scope.system=all&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:07.907778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.017651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2cab9-1ecd-4c22-bc12-a8081bf77180 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.036628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91945e6e-7ece-43df-8f15-defb687ecb8c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.084966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.086506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.087044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.087672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.087830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.088154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.088284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.089086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] PATH_INFO: `/v3/users/775d223492d14497a74692f683cb90f4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.092380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] RBAC: Authorizing `identity:get_user(user_id=775d223492d14497a74692f683cb90f4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:08.095933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:08.100534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:08.100963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 156/311] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/users/775d223492d14497a74692f683cb90f4 => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:08.106582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:08.107788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:08.115658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 156/312] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:08.116934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.121372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.154133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:08.174556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:08.239653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeac89-56ab-4caa-8fee-c9f4eb166e7a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.262050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57276eee-5410-483f-ae2e-2ef3e81e7963 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.281242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.282929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.283447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.283946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.285250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:08.285822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:08.288453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:08.304173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 157/313] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:08.310721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.323419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.325147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.325644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.326699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] PATH_INFO: `/v3/system/users/775d223492d14497a74692f683cb90f4/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.330836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=775d223492d14497a74692f683cb90f4, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:08.333253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:08.390126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:08.426067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312fd8d-52e6-4c53-95d3-be9c8fc45b52 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.428198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 157/314] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Aug 1 14:01:08 2022] PUT /identity/v3/system/users/775d223492d14497a74692f683cb90f4/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:01:08.468671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.469426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.469714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.470126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] PATH_INFO: `/v3/users/8c962aba6b2641a5ad7a4ecd9b937781` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.471526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] RBAC: Authorizing `identity:get_user(user_id=8c962aba6b2641a5ad7a4ecd9b937781)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:08.473079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:08.475147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 158/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:08 2022] GET /identity/v3/users/8c962aba6b2641a5ad7a4ecd9b937781 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:08.482100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.605709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:08.617456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036edfa-4868-46fd-aacf-0006e0acaec6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:08.660022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:08.660709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:08.660990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:08.661266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:08.740231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:08.742243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:08.843370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:08.858004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 158/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:08.859293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:08.973973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d745-9201-4a97-ae48-8623720b482a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:09.012069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:09.012750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:09.013051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:09.013290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:09.014497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:09.016020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35459-43e7-4915-98e5-03355ec943c1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:09.018046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 159/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:08 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:09.023938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:09.139657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850d9c-232c-48a3-b67b-315f46a269af None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:09.188097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:09.189082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:09.189549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:09.190057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:09.191493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, scope.project.id=ea93c966d7014dab8ed22d73db2a2097, user.id=8c962aba6b2641a5ad7a4ecd9b937781) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:09.192003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:09.194517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b9b82-9d99-4275-b989-daa2286358d1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:09.207065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 159/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:09 2022] GET /identity/v3/role_assignments?user.id=8c962aba6b2641a5ad7a4ecd9b937781&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:09.703849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d3c8-a623-46d5-a8e7-e771396fab22 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:09.707184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d3c8-a623-46d5-a8e7-e771396fab22 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:09.707184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d3c8-a623-46d5-a8e7-e771396fab22 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:09.707184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 160/319] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:09.714200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:09.714829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:09.714829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:09.733924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:09.735163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:09.796360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:09.813896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 160/320] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:09.835574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d3c8-a623-46d5-a8e7-e771396fab22 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:09.840666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:09.949000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d3c8-a623-46d5-a8e7-e771396fab22 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:09.984820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:09.985385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:09.985667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:09.985969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:09.987207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:09.988654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d2830-b117-43de-ab8e-5d744c45a494 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:09.991223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 161/321] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:09.996769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.101664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a0760-5625-47e3-a74a-3463dafbcaa9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.103177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e818d-912f-4d5b-91f0-b880f6f646ff None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.103524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e818d-912f-4d5b-91f0-b880f6f646ff None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.103850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e818d-912f-4d5b-91f0-b880f6f646ff None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.105380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 162/322] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:10.110497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.110788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.111070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.129844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:10.131071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:10.139075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.139711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.140003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.140285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] PATH_INFO: `/v3/groups` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.141021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:10.142553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:10.205255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 163/323] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:10.227143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.230196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:10.249957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 161/324] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Aug 1 14:01:09 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:10.346335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850196a-eb41-4973-803e-a8e2a11b5ab2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.387326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.387991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.388272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.388547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.400171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:10.405589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:10.406484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:10.407285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 164/325] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:10.412729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.463779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:10.527378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9013b-8e68-4d6b-b0c6-f601cd138363 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.571548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.573210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.573719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.574261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.575607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:10.576175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:10.579032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5fbb-080e-4c58-8bfc-c842acdcbfed None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:10.596745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 162/326] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:10.606716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.629042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0772d-fe36-42c6-a7cb-19df279bc1e1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.629362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0772d-fe36-42c6-a7cb-19df279bc1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.629615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0772d-fe36-42c6-a7cb-19df279bc1e1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.631031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 163/327] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:10.643837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.644304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.644731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.679575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:10.681718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:10.719012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:10.779997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644218-37ec-4538-97d4-9832b7c70005 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.786190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 164/328] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:10.816729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.818151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.819001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.819294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.819575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] PATH_INFO: `/v3/users/eaeeaea0ac0746b5892e1302f12ee73a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.820786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] RBAC: Authorizing `identity:get_user(user_id=eaeeaea0ac0746b5892e1302f12ee73a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:10.822623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:10.825600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 165/329] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:10 2022] GET /identity/v3/users/eaeeaea0ac0746b5892e1302f12ee73a => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:10.833961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:10.868230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:10.934702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8cd04-2aee-4e99-a012-4d7978f636ad None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.949712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e663d9-eb7d-409b-87fe-1950b0460e35 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:10.972688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.973247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.973535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.973863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.983232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:10.985928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:10.990172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:10.991111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:10.991599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:10.992070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] PATH_INFO: `/v3/system/users/eaeeaea0ac0746b5892e1302f12ee73a/roles/7c65eee24ca3485587699dd2b78c54e5` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:10.992350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:10.993203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:10.998475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 165/330] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:10.999461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eaeeaea0ac0746b5892e1302f12ee73a, role_id=7c65eee24ca3485587699dd2b78c54e5)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:10.999461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:10.999863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:11.085661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 166/331] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Aug 1 14:01:10 2022] PUT /identity/v3/system/users/eaeeaea0ac0746b5892e1302f12ee73a/roles/7c65eee24ca3485587699dd2b78c54e5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:11.115369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:11.122124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0288406-ee55-4375-8550-070a3509e64e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:11.169191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:11.169931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:11.170226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:11.170501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:11.171303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:11.171684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:11.173248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:11.185367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 166/332] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:11.191462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:11.342542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0803940-abe2-4267-bfdb-e0ad710327c7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:11.378902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:11.379561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:11.379849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:11.380133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] PATH_INFO: `/v3/users/775d223492d14497a74692f683cb90f4` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:11.381327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] RBAC: Authorizing `identity:get_user(user_id=775d223492d14497a74692f683cb90f4)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:11.382798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473fe0-4803-44d8-a902-b8fcc5183510 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:11.385776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 167/333] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:11 2022] GET /identity/v3/users/775d223492d14497a74692f683cb90f4 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:11.391722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:11.502095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289a69-6560-4e51-9ca7-aae63fe2e9ea None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:11.538491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:11.539120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:11.539407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:11.539686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:11.540484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] RBAC: Adding query filter params (role.id=e9a1c6082491409eae9864b0d1b03f13, user.id=775d223492d14497a74692f683cb90f4, scope.system=all) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:11.541496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:11.543059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325c5a-1e91-43e6-bfa7-5c2ec0713538 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:11.556076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 167/334] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Aug 1 14:01:11 2022] GET /identity/v3/role_assignments?user.id=775d223492d14497a74692f683cb90f4&scope.system=all&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:12.874411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4014-a49f-4a0a-8ca8-6c561f6d2e36 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:12.875919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4014-a49f-4a0a-8ca8-6c561f6d2e36 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:12.876702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4014-a49f-4a0a-8ca8-6c561f6d2e36 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:12.879779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 168/335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:12.890175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:12.891560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:12.892307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:12.929623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:12.932177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:12.965364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:13.091733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 168/336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:13.132513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4014-a49f-4a0a-8ca8-6c561f6d2e36 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:13.227018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:13.279338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4014-a49f-4a0a-8ca8-6c561f6d2e36 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:13.328931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:13.329592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:13.329927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:13.330207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:13.343963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:13.349319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:13.350264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:13.351227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 169/337] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:13.358795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:13.505599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355cf0e-0695-4e59-9b82-fae15c324960 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:13.555932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:13.556609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:13.556896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:13.557373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:13.558232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:13.558545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:13.559989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445a8e8-6019-49fe-a374-ed55dd4b33b3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:13.569165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 169/338] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:13.576440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:13.716437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6411-1435-427b-9101-a9bd6ea924e2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:13.716687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6411-1435-427b-9101-a9bd6ea924e2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:13.716929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6411-1435-427b-9101-a9bd6ea924e2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:13.718340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 170/339] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:13.723737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:13.724028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:13.724312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:13.742102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ec50-f554-42a5-8a67-49a2bec3e965 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:13.755995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:13.757281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:13.762201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:13.812407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:13.860355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 171/340] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:13.870514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:13.871169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:13.871457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:13.871740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:13.910883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:13.995264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:13.997602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:14.069145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db610-d4ea-4d91-8d12-1f059e1944b7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:14.142254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:14.142923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.143209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.143487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.163393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:14.171000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:14.187684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:14.188771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:14.189827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 172/341] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:14.194970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:14.247370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 170/342] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:14.257735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:14.302226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:14.440049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29221d9d-1278-4dc2-ab2d-72de5c6bbc13 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:14.459909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edb336-2799-4c6e-b8df-5422b62db6ad None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:14.493258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:14.494517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.495020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.495375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.496073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:14.496384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:14.497857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166482-7e94-406c-afc7-ecf76223fe96 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:14.512389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 173/343] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:14.513682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaa9e-4142-4413-a990-019b385128da None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.513994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaa9e-4142-4413-a990-019b385128da None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.514275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faaa9e-4142-4413-a990-019b385128da None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.515740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 174/344] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:14.521367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faaa9e-4142-4413-a990-019b385128da None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:14.541154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:14.541966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.542392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.542799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.544782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:14.547015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dc171-d719-4a8f-9ace-7199bce2a11b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:14.549959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 171/345] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:14.555607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.556036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.557152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.597800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:14.603341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:14.605532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:14.651357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faaa9e-4142-4413-a990-019b385128da None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:14.688112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:14.693562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.693562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.693562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.747507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 172/346] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:14.748574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:14.794353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:14.808016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:14.810535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049057-0201-4c15-82d6-5067e463cb3d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:14.901308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:14.907795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865afcb-e81f-41a6-9699-facfd4bc07f2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:14.948996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:14.949716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.950035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.950313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.960754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 175/347] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:01:14.961338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:14.963476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce017-ffd1-404c-9d54-f95eb1656e46 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.963916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce017-ffd1-404c-9d54-f95eb1656e46 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.964023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:14.964423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce017-ffd1-404c-9d54-f95eb1656e46 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.966152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 176/349] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:14.966280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 173/349] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:14.966947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:14.967472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3156-cdcb-49dc-a2dc-deca9a324a9f None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:14.967758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3156-cdcb-49dc-a2dc-deca9a324a9f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:14.968032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3156-cdcb-49dc-a2dc-deca9a324a9f None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:14.969358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 177/350] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:14.970518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3156-cdcb-49dc-a2dc-deca9a324a9f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.080416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.096758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40f1c-ca85-47c0-b039-59e46cf16c60 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.120105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3156-cdcb-49dc-a2dc-deca9a324a9f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.144358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.145262 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.145709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.146238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.157954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e81c8a4d-dda6-4019-b52d-5337eab91fbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:15.166459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:15.167449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:15.168270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 174/351] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:15.169514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.169728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.170061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.172262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.173177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.173673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.174187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.175576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:15.177020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aeca6-2d3b-44de-b32b-9ed32021c716 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:15.178945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 178/352] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:14 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:15.179961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.180560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.180560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.195216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:15.197732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:15.202914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:15.204150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:15.249407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.294706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 175/353] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:15.295955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.314872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 179/354] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:15.316082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.412668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.455664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafc17a-c00b-4109-88f2-d76a5cda18c5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.471066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394651-5fcf-49f7-a0ed-860de6aba308 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.513698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.514293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.514676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.515746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.516702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=b15ff892e1734aabb3baa55cb43a069d) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:15.517109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:15.518738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:15.524687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.528453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.528453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.528453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.528453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:15.528453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:15.529475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:15.533164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 176/355] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:15.533164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.545043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 180/356] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:15.546017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.585063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.681652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67585a-64ce-4cc2-94ec-98f4951f5a15 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.693304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569f32-7a7e-4f7e-bf9a-5069ce74e81d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.733193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.733904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.734204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.734481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.735670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:15.737167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:15.737816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.738477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.738766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.739044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.739148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 177/357] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:15.739907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.750144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.751204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:15.756727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:15.757720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:15.758554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:15.763277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 181/358] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:15.763277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.873187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:15.876006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a1ce-408c-4910-a1f7-4198905f57de None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.903464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb309-b954-4ce6-be58-963400df69ce None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:15.936791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.937366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.937655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.937976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.956467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-2ce3ef7f-23a7-4361-af06-90a7a932a001 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:15.959480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:15.960595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:15.961401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 178/359] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:15.964405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766366b8-c477-479e-aead-16f2d3f854c3 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.964405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766366b8-c477-479e-aead-16f2d3f854c3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.964405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766366b8-c477-479e-aead-16f2d3f854c3 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:15.964929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 179/360] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:15.965646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766366b8-c477-479e-aead-16f2d3f854c3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:15.966262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:15.966923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:15.967191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:15.967471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.060476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.061295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.062586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad9e8c-9f0e-4b8c-bbfe-7f07c4a0ded1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.111931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766366b8-c477-479e-aead-16f2d3f854c3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.163258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.163904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.164193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.164473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.165276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=b15ff892e1734aabb3baa55cb43a069d) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:16.166381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.168235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.179661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 180/361] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:16.179911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.187116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.226371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 182/362] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:16.231770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.232709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.233564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.275771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:16.278272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:16.406234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47005-a7d8-4ef2-8e6a-ba0dc4d2a0cf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.418826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 183/363] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:16.419688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.455854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.456364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.456653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.456935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.457667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:16.458042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.459423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.466734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.469310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 181/364] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:16.470168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.582868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94889932-293a-4897-bd96-b1a2cc26bf55 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.593310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c84482-94a7-40c5-aad2-5d0fdcaae771 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.609711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.630857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.631417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.632537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.632537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.634758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.636641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.639019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 182/365] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:16.639396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.645016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.647079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.647605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.648120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.649370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:16.651131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.653002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.664002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 184/366] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:16.665252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.707874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.751661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc74fc-e36f-453b-9ae0-cf423d8e4397 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.782331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebeb9-36e8-431f-ac77-758c7f1a1828 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.794600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.795647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.796567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.797332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.812644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:16.820442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:16.821346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:16.822286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:16.824934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 183/367] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:16.826153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:16.827729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:16.828802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:16.829192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:16.831266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:16.891579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:16.921120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:16.922801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:16.968350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888ca51-082d-4074-8167-43ecea5f6839 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:16.996277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.022712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.023888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.024394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.025509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.027168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.029396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.031510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 184/368] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.032829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.070707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 185/369] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:17.072668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.150995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854598d-e744-4734-8f59-323c58bc01bb None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.158493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.188476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.189491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.190109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.190586 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] PATH_INFO: `/v3/users/eaeeaea0ac0746b5892e1302f12ee73a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.192060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] RBAC: Authorizing `identity:get_user(user_id=eaeeaea0ac0746b5892e1302f12ee73a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.193848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.193969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a990-1031-4549-a245-b6a5b43f296b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.196092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 185/370] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/users/eaeeaea0ac0746b5892e1302f12ee73a => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.198640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.238045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.238599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.238887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.239168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.240349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:17.240349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.241692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.251440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 186/371] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.252282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.267096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.316744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed72e6-f03e-4733-abe5-4315ad902001 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.356408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.357463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.357995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.358472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.359624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ea93c966d7014dab8ed22d73db2a2097) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:17.360280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.362122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.366113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5187a-6010-4ccc-b956-c7fddfd28d12 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.369928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 186/372] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.371060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.408598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.409425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.409929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.410228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.412795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.415397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.419233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 187/373] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.420756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.425326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.496671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e5e9-0133-43c3-9380-f00a8f2db7a4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.524372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.543546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d863c1-08e0-409f-8669-f23e271be736 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.545165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.547084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.547084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.547993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.548817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] RBAC: Adding query filter params (role.id=7c65eee24ca3485587699dd2b78c54e5, user.id=eaeeaea0ac0746b5892e1302f12ee73a, scope.system=all) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:17.549332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.551466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.568360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 187/374] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/role_assignments?user.id=eaeeaea0ac0746b5892e1302f12ee73a&scope.system=all&role.id=7c65eee24ca3485587699dd2b78c54e5 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.569364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.587208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.588223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.589364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.590660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.685176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.687104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.690816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.704201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf1c-2943-447d-97da-25bdddbd226e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.742050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:17.742683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:17.743068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:17.743445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:17.745623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:17.747297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:17.749737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 188/375] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:17.756791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.816901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:17.835944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 188/376] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:17.842560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:17.936722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80914-fe04-4d5a-8ce4-8151c6a9f71b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.972098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa242c-5849-4b2a-8b67-bc5072b0fb9d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:17.975423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:18.021977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.022873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.023263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.023486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.023924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] PATH_INFO: `/v3/projects/40846723d7f04d9ab8a9bf11d431617b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.024195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.024577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.025611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.026414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] RBAC: Authorizing `identity:get_project(project_id=40846723d7f04d9ab8a9bf11d431617b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.028056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.030264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 189/377] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/projects/40846723d7f04d9ab8a9bf11d431617b => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:18.031648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=ea93c966d7014dab8ed22d73db2a2097) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:18.031648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.032759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb3266-172d-4f32-ab69-0110a604a01e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.035950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:18.047517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 189/378] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:17 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:18.050107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434ec1-0c96-4b6f-8f0a-93cb16db0f51 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.050761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434ec1-0c96-4b6f-8f0a-93cb16db0f51 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.050761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76434ec1-0c96-4b6f-8f0a-93cb16db0f51 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.052544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 190/379] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:18.060446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f831-5742-4752-acba-66da518fd52b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.060805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f831-5742-4752-acba-66da518fd52b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.061424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f831-5742-4752-acba-66da518fd52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.094464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3e87f831-5742-4752-acba-66da518fd52b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:18.095788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3e87f831-5742-4752-acba-66da518fd52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:18.178107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61434b-1ddf-426e-b1a9-35f1a587ecae None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:18.220312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 191/380] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:18.226667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.227718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.228233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.228696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] PATH_INFO: `/v3/groups/a475d31d2439403cb2a82545007c0f40` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.237798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] RBAC: Authorizing `identity:get_group(group_id=a475d31d2439403cb2a82545007c0f40)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.239583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.241894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 190/381] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:18 2022] GET /identity/v3/groups/a475d31d2439403cb2a82545007c0f40 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:18.248935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f831-5742-4752-acba-66da518fd52b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:18.265706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:18.327185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:18.335461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:18.412804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f831-5742-4752-acba-66da518fd52b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:18.456793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.457436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.457721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.458033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.459400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] RBAC: Adding query filter params (group.id=a475d31d2439403cb2a82545007c0f40, role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=40846723d7f04d9ab8a9bf11d431617b) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:18.459716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.461506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.469415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 192/382] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:18 2022] GET /identity/v3/role_assignments?group.id=a475d31d2439403cb2a82545007c0f40&scope.project.id=40846723d7f04d9ab8a9bf11d431617b&role.id=1c201ebfc669434982f999e02a45c09f => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:18.482836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475eb9-f164-4a20-99e8-c10ab6e051d6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:18.539575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.541155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.541652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.542150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.562945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:18.568952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:18.569962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:18.570888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:18.573430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 191/383] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:18.580689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:18.716578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb91d-c694-431c-ad73-28f58af3924f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:18.719534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:18.775521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.776307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.776827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.777252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.779122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:18.779671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.782334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.798318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 193/384] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:18.804670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:18.942395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:18.949089 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ff5d-8be4-4d90-9065-138eb170eabb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:18.989320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:18.990005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:18.990293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:18.990574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:18.992152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:18.995901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e645a5f-e441-44dd-9136-98e367e45f91 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:18.998256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 192/385] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:18 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:19.003634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:19.121544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d0f42-0c39-47ad-b805-985b2d66fe64 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:19.162541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:19.163321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.163634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.163911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.164712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca338a2-e81d-48df-8b86-dde4f77c26f3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.165205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca338a2-e81d-48df-8b86-dde4f77c26f3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.166298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca338a2-e81d-48df-8b86-dde4f77c26f3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.171937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:19.172092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:19.172340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 193/386] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:19.173980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 194/387] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:19 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:19.174436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.174967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.175445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.179452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:19.198252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:19.200109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:19.254421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:19.281892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 194/388] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:19.349098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:19.364657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af88496-f095-42db-8d88-3fbd39d0b735 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:19.446496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:19.451048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.454035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.454867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.460912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, group_id=65e7018baa0341f3bc427b1a05b97dd8, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:19.466200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:19.535542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 195/389] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Aug 1 14:01:19 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:01:19.550288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:19.558642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28dee-2d36-4ea9-8825-cddc1ffeb5d0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:19.604480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:19.605647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.606170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.606646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.622682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:19.628944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:19.630454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:19.631809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:19.636095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 195/390] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:19.641921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:19.778402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:19.787042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ed6ce-5309-4658-9c8d-51b87b9de494 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:19.856115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:19.856766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:19.857048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:19.857320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:19.858095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:19.858400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:19.859797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:19.871164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 196/391] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:19.876603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:20.012742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0eea-7a97-44fc-85ae-502a788f8467 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:20.054304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:20.054876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.055166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.055448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.062549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:20.064036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:20.065836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 196/392] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:19 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:20.071457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:20.218028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8ce3-c0fb-438c-9df4-4ecd0065ae95 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:20.273439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:20.274281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.274471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.274712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.275961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:20.277435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3ac42-b1a2-4e52-8f6b-96b30067e73e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:20.279468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 197/393] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:20 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:20.285208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:20.347301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:20.464045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bacad-0d0f-40b2-a306-dab23a8f497e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:20.501174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:20.502303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.502731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.503233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.505703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] RBAC: Authorizing `identity:create_grant(project_id=b15ff892e1734aabb3baa55cb43a069d, group_id=65e7018baa0341f3bc427b1a05b97dd8, role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:20.507266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:20.555794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278758a-5139-4b75-ac0c-456ff88f384e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.556171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278758a-5139-4b75-ac0c-456ff88f384e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.556460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278758a-5139-4b75-ac0c-456ff88f384e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.558374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 198/394] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:20.563630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896c-1a21-4d0f-8ee9-ca5e39ea8374 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.563911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896c-1a21-4d0f-8ee9-ca5e39ea8374 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.564190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896c-1a21-4d0f-8ee9-ca5e39ea8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.583521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9907896c-1a21-4d0f-8ee9-ca5e39ea8374 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:20.584716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9907896c-1a21-4d0f-8ee9-ca5e39ea8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:20.588997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 197/395] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Aug 1 14:01:20 2022] PUT /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/b43b05a5c1b8468d880c67404b4f733e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:20.606382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:20.664348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 199/396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:20.689284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:20.825321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:20.845058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e538b-42cb-415a-a7ea-f4b3b5397607 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:20.858610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc7e6-e396-45c4-a924-325ad3920332 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.858886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc7e6-e396-45c4-a924-325ad3920332 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.859086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dc7e6-e396-45c4-a924-325ad3920332 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.860604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 200/397] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:20.866373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.866373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.869779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.892146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:20.893931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:20.899997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:20.901009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:20.901497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:20.902024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:20.912950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:20.919287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:20.920196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:20.921017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:20.923772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 198/398] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:20.937140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:20.982977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 201/399] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:21.007255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.093647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c61c-4632-498d-a6be-f6d9cbf77dcd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.134323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.136093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.137020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.137829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.139428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:21.140260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.142945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.163290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 199/400] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:21.168678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.178921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.191796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.205541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e5d3-7f59-448a-83fe-2c00d012e1b2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.257782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.258254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.258537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.258810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.271788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-171c9a2c-09a7-47a2-999d-481159c7c99c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:21.279621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:21.282453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 202/401] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:21.283757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ad23-2ac9-4c27-a897-81bf3c137538 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.284972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ad23-2ac9-4c27-a897-81bf3c137538 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.284972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ad23-2ac9-4c27-a897-81bf3c137538 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.289475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 203/402] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:21.290252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1ad23-2ac9-4c27-a897-81bf3c137538 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.356634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f68d6-a7f3-41e6-9462-abebc023f6f5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.425070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1ad23-2ac9-4c27-a897-81bf3c137538 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.434125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.437392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.437392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.438864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.441596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.444089 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98523aca-58ea-47cd-a103-0eaf14cce250 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.447052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 200/403] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:21.449120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.449599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.450086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.473093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.473922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.474210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.474494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.475379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:21.475588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.477034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.483339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:21.485723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:21.487587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 204/404] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:21.488426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.498782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.584311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 201/405] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:21.585559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.588901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.619508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451a70-a738-481d-a152-e8cddbc364f6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.666856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.667100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.667367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.667650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.668935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.670692 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.672458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 205/406] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:21.673242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.716872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f05e-1700-452e-8915-fb295bf3e5b0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.761212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.764093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.765118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.765559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.766007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.767442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.769113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.771406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 202/407] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:21.772540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.789134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ab6f8-147f-4ff5-8114-701848941031 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.828391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.829142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.829504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.829884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.841840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:21.847388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:21.848314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:21.849091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:21.854468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 206/408] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:21.855477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:21.867925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:21.907594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3373-0716-42d4-9859-f2bceb169f54 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:21.950149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:21.952319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:21.953530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:21.955226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:21.958674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, group_id=65e7018baa0341f3bc427b1a05b97dd8, role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:21.960356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:21.985594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e435a5-91ef-48d9-9e69-18b508af6830 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.022771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.023522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.023964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.024382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.027002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:22.029552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:22.033141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 207/409] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:21 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:22.037891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.041292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:22.056173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 203/410] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Aug 1 14:01:21 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/b43b05a5c1b8468d880c67404b4f733e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:22.063670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.252944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42fa74-9699-4120-a26e-f2805ba70eac None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.268778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b48eef-efe3-4b5c-882e-fe2d20d248fc None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.286120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:22.291472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.297153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.297153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.297153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.297153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea93c966d7014dab8ed22d73db2a2097, group_id=65e7018baa0341f3bc427b1a05b97dd8, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:22.297153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622066-0dd1-4c6e-b304-0be1067b6ea5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:22.309365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.310140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.310495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.310845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.311647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:22.312040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:22.313498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad0fc-7994-4639-908d-62c428faff57 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:22.324375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 208/411] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:22.325786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab4b1-6fdc-4c8e-9f56-28dd9d72be29 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.326151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab4b1-6fdc-4c8e-9f56-28dd9d72be29 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.326515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab4b1-6fdc-4c8e-9f56-28dd9d72be29 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.327854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 209/412] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:22.330173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fab4b1-6fdc-4c8e-9f56-28dd9d72be29 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.373696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 204/413] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Aug 1 14:01:22 2022] PUT /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097/groups/65e7018baa0341f3bc427b1a05b97dd8/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:22.381424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.381809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.382117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.412150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:22.422947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:22.424257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:22.471293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fab4b1-6fdc-4c8e-9f56-28dd9d72be29 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.551048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.551668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.551930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.552221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] PATH_INFO: `/v3/groups/a475d31d2439403cb2a82545007c0f40` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.559216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] RBAC: Authorizing `identity:get_group(group_id=a475d31d2439403cb2a82545007c0f40)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:22.563536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:22.567772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 210/414] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:22 2022] GET /identity/v3/groups/a475d31d2439403cb2a82545007c0f40 => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:22.576942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.625791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 205/415] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:22.658755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.750764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ab250-eae7-4de9-a6e6-f637289ae919 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.795510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e3b1-d434-4dd2-b476-4d2641786c7c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:22.823596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:22.826676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:22.836137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.836797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.837080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.837388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] PATH_INFO: `/v3/projects/40846723d7f04d9ab8a9bf11d431617b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.839949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] RBAC: Authorizing `identity:get_project(project_id=40846723d7f04d9ab8a9bf11d431617b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:22.842909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:22.844883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 211/416] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:22 2022] GET /identity/v3/projects/40846723d7f04d9ab8a9bf11d431617b => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:22.851649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:22.857189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:22.857885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:22.858168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:22.858443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:22.884807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:22.890054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:22.890984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:22.891780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:22.892683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 206/417] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:22.898093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.008014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02638c0-6059-4919-9a61-5961b44604ca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.045409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaebbb-1ba9-459d-b255-e7efac270899 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.045604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.046095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.046382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.046659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.047382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:23.047694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:23.049087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ca19a-d37a-4f81-9e6c-6cf944f195e0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:23.058849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 207/418] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:23.060095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288306-ad7f-4713-943c-6e0dcc9e2f2d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.060390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288306-ad7f-4713-943c-6e0dcc9e2f2d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.060674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288306-ad7f-4713-943c-6e0dcc9e2f2d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.066637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 208/419] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:23.067458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288306-ad7f-4713-943c-6e0dcc9e2f2d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.087142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.088470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.089001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.089518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] PATH_INFO: `/v3/projects/40846723d7f04d9ab8a9bf11d431617b/groups/a475d31d2439403cb2a82545007c0f40/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.092471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=40846723d7f04d9ab8a9bf11d431617b, group_id=a475d31d2439403cb2a82545007c0f40, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:23.094809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c844f-9dac-4c47-b34f-e89ede8bf5b7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:23.114564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:23.179994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 212/420] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Aug 1 14:01:22 2022] PUT /identity/v3/projects/40846723d7f04d9ab8a9bf11d431617b/groups/a475d31d2439403cb2a82545007c0f40/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:23.179994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.179994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.179994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.184488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288306-ad7f-4713-943c-6e0dcc9e2f2d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.204816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:23.206440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:23.255636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.256280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.256562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.256836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.317169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:23.338956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 213/421] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:23.355421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:23.356921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:23.381795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.409004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:23.476311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 209/422] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:23.484960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.548854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456bcdb-290f-4892-8164-4af999dcc467 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.587149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.588759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.589314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.589880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.595969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ff36-ee9c-4efd-a0cc-17366f2df674 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.603942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:23.611154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:23.612059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:23.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:23.615875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 214/423] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:23.626795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.636260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.637011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.637409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.637795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.648355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:23.656411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:23.660859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 210/424] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:23.667894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.692615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:23.743749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:23.808039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd91c1-f3af-409e-8bd3-7460aa9aacd5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.846252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.846797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.847082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.847360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.848087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:23.848394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:23.849797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:23.859109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 215/425] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:23.864841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:23.883560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c87ea-0039-438e-b3a8-b0e7327aace9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:23.992984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:23.993697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:23.994082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:23.994361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:23.998829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.000301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.001966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 211/426] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:24.013780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6299066-c724-4cc5-82dc-33b692035bc4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.019233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.042012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.110042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.130822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.131889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.132385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.132558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02960-c489-4efb-a670-c5fa8270a1a4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.132888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.171599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.172506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.172794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.173072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.174126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=b15ff892e1734aabb3baa55cb43a069d) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:24.174441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.176198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.184311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 212/427] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:24.286279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.288135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ea854-b13b-4496-bab2-100d5629125b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.430332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 216/428] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:24.436466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.518544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc648fa-499f-43dc-997c-f44cc2ce67c3 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.518890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc648fa-499f-43dc-997c-f44cc2ce67c3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.519114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc648fa-499f-43dc-997c-f44cc2ce67c3 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.520725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 217/429] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:24.530138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.530737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.531214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.555990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:24.556181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8d9e-eaf4-452c-8484-c8b997d41f72 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.558132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:24.578644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.601031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.601822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.602116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.606909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] PATH_INFO: `/v3/projects/b15ff892e1734aabb3baa55cb43a069d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.606909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] RBAC: Authorizing `identity:get_project(project_id=b15ff892e1734aabb3baa55cb43a069d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.606909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.607366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 213/430] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/projects/b15ff892e1734aabb3baa55cb43a069d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:24.612811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.636981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.649518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 218/431] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:24.674866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.736534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5b98-0f13-47a5-92bb-157cb4bd6c85 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.774978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.775484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.775944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.776228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.777428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.779259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.781278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 214/432] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:24.786896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.801550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b786-a716-461f-8419-d7d51dba9830 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.844687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.845357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.845644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.845954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.863738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:24.869939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:24.870878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:24.871673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:24.876035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 219/433] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:24.877287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:24.895267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.918277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:24.933103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee7cdc-5449-4c70-8ef9-3c42fa1c33c0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:24.981902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:24.982540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:24.982831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:24.983111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:24.983911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=b15ff892e1734aabb3baa55cb43a069d) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:24.984228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:24.988692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a3c5-d962-4de4-a8ec-b5528a003d3e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:24.996171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 215/434] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=b15ff892e1734aabb3baa55cb43a069d&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:25.010786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441c5c-5153-4c2a-b579-09ff851b6f9d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.031274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9cde-e52d-493e-aed9-79562229ff08 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.031565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9cde-e52d-493e-aed9-79562229ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.031840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9cde-e52d-493e-aed9-79562229ff08 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.035824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 216/435] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:25.043603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.043899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.044158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.063289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.064263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.064550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.064823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.065577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:25.066637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.068207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.069399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:25.071933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:25.079272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 220/436] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:25.084771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.184624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.189786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 217/437] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:25.210956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.232644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f03af-06ca-42e2-93e5-0108af83cbd1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.278769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.279477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.279861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.280239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.299689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.341741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e224ff-1d18-4863-8262-e519a469a4ca None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.376312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.378839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.390924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.391668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.392008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.392307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.412982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:25.417880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:25.418815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:25.419603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 218/438] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:25.425658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.466796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.526415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 221/439] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:01:25.535289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.552783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347220f-e38c-4e58-9a71-a1dbbec7d14d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.590579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.596491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.597121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.597713 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.598036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.599101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:25.599469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.601447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.617932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 219/440] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:25.619288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.658311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b919593-e85e-4be7-910f-d002ff251d70 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.694706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.697217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.697217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.697217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.697974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.699445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.701250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 222/441] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:25.707431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.746307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.748014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f696bb9-409c-46e4-a3da-3a09e60077c2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.790112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.790740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.790992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.791281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.833253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fef54-2ba2-4782-9d71-67956609a4c7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.859775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.867557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.869577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688b55-21c8-480e-a1e3-8b07e9d19c91 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.876650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:25.877308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.877590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.877901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.879097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:25.880562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1191e-a3b7-4322-89f8-258586447c84 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:25.882179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 223/442] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:25.884256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b86a-3705-40bf-a63e-a0fa68a04f15 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.884550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b86a-3705-40bf-a63e-a0fa68a04f15 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.884834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340b86a-3705-40bf-a63e-a0fa68a04f15 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.886614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 224/443] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:25.888567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340b86a-3705-40bf-a63e-a0fa68a04f15 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:25.973116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 220/444] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:25.974394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:25.974683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:25.974957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:25.988906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:25.992644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340b86a-3705-40bf-a63e-a0fa68a04f15 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:25.993111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:25.994392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:26.027885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.028560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.028848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.029123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.029956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ea93c966d7014dab8ed22d73db2a2097) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:26.030274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.031709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.037654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 225/445] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:25 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:26.038485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.069860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 221/446] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:26.092545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.119768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.166904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18e9b0-2e64-41fd-b85b-e1d0250f7af1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.206327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.209787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.209787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.209787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] PATH_INFO: `/v3/projects/ea93c966d7014dab8ed22d73db2a2097` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.210865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ea93c966d7014dab8ed22d73db2a2097)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.212934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.217393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 226/447] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/projects/ea93c966d7014dab8ed22d73db2a2097 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:26.220610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.231407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32f627-5327-4f7c-b26e-633369e13754 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.256187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.269312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.270033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.270552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.270552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.281804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:26.286704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:26.287779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:26.288747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 222/448] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:26.294012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.336991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fa55-56dc-4e60-9fcc-70db6e37c9b1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.375815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.376491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.376762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.377042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] PATH_INFO: `/v3/groups/65e7018baa0341f3bc427b1a05b97dd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.378279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] RBAC: Authorizing `identity:get_group(group_id=65e7018baa0341f3bc427b1a05b97dd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.379724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.381330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 227/449] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/groups/65e7018baa0341f3bc427b1a05b97dd8 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:26.388106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.388637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.404726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be39b7-ebbe-40da-816e-124a6b8dd307 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.441076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.441700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.442045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.442329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.443053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:26.443370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.444749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.453897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 223/450] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:26.459953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.485251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.488808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8789-46f1-41e4-9c4b-0d5c864db51b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.525281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.525962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.526248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.526523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.527329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] RBAC: Adding query filter params (group.id=65e7018baa0341f3bc427b1a05b97dd8, role.id=e9a1c6082491409eae9864b0d1b03f13, scope.project.id=ea93c966d7014dab8ed22d73db2a2097) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:26.527644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.529100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.535412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 228/451] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/role_assignments?group.id=65e7018baa0341f3bc427b1a05b97dd8&scope.project.id=ea93c966d7014dab8ed22d73db2a2097&role.id=e9a1c6082491409eae9864b0d1b03f13 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:26.567121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579ab76-1e11-4414-8fdb-64057a6e7594 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.603870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.604410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.604694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.604972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.623367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.678980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.680451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.794827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 224/452] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:26.800900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:26.913716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43aea6-47cd-4230-b65d-9d8941c3f3ce None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:26.948598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:26.949250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:26.949528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:26.949834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] PATH_INFO: `/v3/projects/40846723d7f04d9ab8a9bf11d431617b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:26.950992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=40846723d7f04d9ab8a9bf11d431617b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:26.952430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:26.954192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 229/453] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/projects/40846723d7f04d9ab8a9bf11d431617b => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:26.959913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:27.013182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:27.072305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d8dd6-0bfd-411f-b253-4d2b3dd19c8a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:27.108030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:27.108673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:27.108954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:27.109230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] PATH_INFO: `/v3/groups/a475d31d2439403cb2a82545007c0f40` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:27.110394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] RBAC: Authorizing `identity:get_group(group_id=a475d31d2439403cb2a82545007c0f40)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:27.111838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acb491-7e62-47ae-865c-73eb329b10bc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:27.113424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 225/454] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Aug 1 14:01:26 2022] GET /identity/v3/groups/a475d31d2439403cb2a82545007c0f40 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:27.120573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:27.152382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:27.222464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336905d-4793-49e7-9afe-0185bf2ee9f9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:27.256002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:27.256621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:27.256906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:27.257176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:27.257988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] RBAC: Adding query filter params (group.id=a475d31d2439403cb2a82545007c0f40, role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=40846723d7f04d9ab8a9bf11d431617b) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:27.258295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:27.260868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4556-d9a7-4ca6-b33f-d6a2068cd957 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:27.266728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 230/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Aug 1 14:01:27 2022] GET /identity/v3/role_assignments?group.id=a475d31d2439403cb2a82545007c0f40&scope.project.id=40846723d7f04d9ab8a9bf11d431617b&role.id=1c201ebfc669434982f999e02a45c09f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:29.985016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641392-a0e9-4f2a-90f8-d08f7506cd91 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:29.985557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641392-a0e9-4f2a-90f8-d08f7506cd91 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:29.985557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641392-a0e9-4f2a-90f8-d08f7506cd91 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:29.987210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 226/456] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:29.992987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e920-5617-4523-8622-03ee6f529324 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:29.994051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e920-5617-4523-8622-03ee6f529324 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:29.994335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e920-5617-4523-8622-03ee6f529324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.022014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8119e920-5617-4523-8622-03ee6f529324 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:30.023169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8119e920-5617-4523-8622-03ee6f529324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:30.121226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 231/457] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:30.150528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10641392-a0e9-4f2a-90f8-d08f7506cd91 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.170088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0258-a248-4efa-8505-f8b4a984b3a0 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.171675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0258-a248-4efa-8505-f8b4a984b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.172332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e0258-a248-4efa-8505-f8b4a984b3a0 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.176183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 232/458] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:30.196372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.197468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.198234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.235972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:30.237285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:30.286343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:30.288306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10641392-a0e9-4f2a-90f8-d08f7506cd91 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:30.313527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:30.335438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:30.336447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.336965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.338062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.349770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:30.351624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:30.369553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:30.370510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:30.371350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:30.371350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:30.371350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:30.371350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:30.374539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 227/459] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:30.381951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.418574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 233/460] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:30.448575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.565081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee640-57dc-451a-b968-29e3f7bdac80 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:30.567501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b1224-85e9-4662-924a-001f3b73f147 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:30.600025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:30.600931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.601415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.601914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.602090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:30.603267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.603714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.603899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:30.604147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.604652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:30.606289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc14e-8fe8-4429-b19d-357464d0722a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:30.614739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:30.616343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:30.626803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 228/461] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:30.626803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a02a-d864-4b3b-a890-8d70d886c1ae None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.626803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a02a-d864-4b3b-a890-8d70d886c1ae None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.626803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a02a-d864-4b3b-a890-8d70d886c1ae None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.627746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 229/462] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:30.628889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c6e02-933d-481c-a57e-01fe206a6971 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.629187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c6e02-933d-481c-a57e-01fe206a6971 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.629464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c6e02-933d-481c-a57e-01fe206a6971 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.630893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 230/463] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:30.633798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c6e02-933d-481c-a57e-01fe206a6971 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-74d3cd9f-69a4-4b86-8dc6-2601b07a8eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:30.639895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:30.640890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:30.642017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:30.642017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:30.642017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:30.642017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:30.645918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 234/464] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:30.647048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ec84-9849-4243-982f-c83591ef6199 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.647334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ec84-9849-4243-982f-c83591ef6199 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.647610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453ec84-9849-4243-982f-c83591ef6199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.665928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1453ec84-9849-4243-982f-c83591ef6199 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:30.667422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1453ec84-9849-4243-982f-c83591ef6199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:30.669370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:30.670242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:30.742275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 235/465] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:30.744916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.745811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.746239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.752339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c6e02-933d-481c-a57e-01fe206a6971 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:30.774377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:30.775602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:30.794403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:30.795023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:30.795306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:30.795598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:30.796238 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:30.797663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:30.850101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 236/466] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:30.850961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.898684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 231/467] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:30 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:30.901481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:30.935990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:30.989821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082a24-69c8-4871-8eef-9f1ccb6560e4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.014702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:31.041960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.042793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.043184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.043382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d987e-7986-4ed9-87f4-095d060858c8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.043687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.044526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:31.044944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.047516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.066252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 237/468] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:31.067298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.096766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.097426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.097716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.098073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.117129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.120900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:31.143597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:31.144538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:31.145401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:31.145401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:31.145401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:31.145401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:31.145401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 232/469] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:31.145709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.231554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d92899-d556-4481-9d09-2b0ec42205fc None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.268052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:31.278592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.281362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.281362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.281362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.291683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.291953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044e5f1-77d4-455e-84a4-406d881958ec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.293419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:31.309941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:31.311043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:31.312091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:31.312091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:31.312091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:31.312091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:31.313785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 238/470] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:31.319263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.344275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.345280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.346255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.346538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.347240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.348733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.362111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:31.441376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 233/471] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:31 2022] POST /identity/v3/users => generated 246 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:31.442771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.444483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd0f5-8c27-4b51-921d-31d1ae1eabed None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.506506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.507653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.508149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.508658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.510471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:31.511073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.512686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ac5ff-4c9b-4ed6-9d67-d1dff260825a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.532583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 239/472] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:31.534454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626c25-dcfc-4e36-aeaa-6df547e16c2e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.535014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626c25-dcfc-4e36-aeaa-6df547e16c2e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.535500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626c25-dcfc-4e36-aeaa-6df547e16c2e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.537181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 240/473] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:31.538992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626c25-dcfc-4e36-aeaa-6df547e16c2e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.591034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:31.592551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01a9ce-6db2-444e-b025-977349320bf9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.640189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.640817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.641100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.641375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.643119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:31.643119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.643770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62ef9-72a1-4ab4-8f05-f1f0af091368 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.657639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 234/474] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:31.661847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.661847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.661847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.666925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626c25-dcfc-4e36-aeaa-6df547e16c2e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.680263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:31.681603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:31.714748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.716421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.717049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.717599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.718754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.721028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:31.738847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:31.764296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 235/475] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:31.765281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.893089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 241/476] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:31 2022] POST /identity/v3/users => generated 248 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:01:31.894391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:31.896629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a112cc7-0fad-4942-b6b6-8413178830e1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:31.966663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:31.967749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:31.968233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:31.968685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:31.969617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:31.971545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:32.031842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:32.039050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3636-f6ba-4510-ae22-8f609d4bd555 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:32.079562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:32.080614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:32.080614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:32.080614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:32.080982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:32.082093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 236/477] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:31 2022] POST /identity/v3/users => generated 249 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:32.082697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:32.133206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.sql.core [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:01:32.133206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 14:01:32.133206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [parameters: {'id': '9e545bec76844dc3b827050cc3957be5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 14:01:32.133206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result.read() Aug 01 14:01:32.152843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:01:32.154421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application yield resource Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise self.value Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application session.commit() Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:01:32.156098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:01:32.158518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:01:32.160401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result.read() Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:01:32.166067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [parameters: {'id': '9e545bec76844dc3b827050cc3957be5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:32.167802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 14:01:32.171121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:32.172947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 242/478] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Aug 1 14:01:31 2022] POST /identity/v3/roles => generated 144 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:32.173097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:32.218101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:32.299074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84d032-bf74-48f7-b9c1-a04af1bd34a7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:32.338936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:32.339663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:32.339956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:32.340233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:32.352744 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c26bab88-cd78-41ea-a379-5c9cb34ae2fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:32.358299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:32.359188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:32.359988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 237/479] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:32.365269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:32.486166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aa676-0f40-4598-bd60-4e68117b716e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:32.525453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:32.526408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:32.526878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:32.527365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:32.528283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:32.528597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:32.530003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a2aaa-592b-4605-9ac0-4dfee1529c8a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:32.539156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 243/480] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:33.247202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72d5e-54d2-4e68-a8cc-f934ebdeff52 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:33.247723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72d5e-54d2-4e68-a8cc-f934ebdeff52 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:33.247830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72d5e-54d2-4e68-a8cc-f934ebdeff52 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:33.249496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 238/481] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:33.255020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:33.255524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:33.255608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:33.282774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:33.284002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:33.302572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:33.356480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 244/482] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:33.399252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72d5e-54d2-4e68-a8cc-f934ebdeff52 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:33.523441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:33.531279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72d5e-54d2-4e68-a8cc-f934ebdeff52 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:33.582668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:33.583326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:33.583611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:33.583930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:33.600346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:33.606072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:33.606971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:33.608773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 239/483] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:33.616243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:33.785869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bb05-eb30-4666-9f86-58fe1862c725 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:33.832881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:33.833565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:33.833879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:33.834160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:33.834890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:33.835197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:33.836576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:33.848386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 245/484] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:33.854746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.013890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eafbd-8ee0-4448-a68c-0679b935d739 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.057502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.058637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.059126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.059609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.075605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:34.077420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f5a9cedc-1099-4afd-aae8-2467aa1e70fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:34.098578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:34.099490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:34.100373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:34.100373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:34.100373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:34.100373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:34.103757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 240/485] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:34.109511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.140576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:34.199882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d15f1-83a5-4832-a9df-b1a84affac55 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.200512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d15f1-83a5-4832-a9df-b1a84affac55 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.200993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d15f1-83a5-4832-a9df-b1a84affac55 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.203950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 241/486] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:34.208504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.209067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.209543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.241582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:34.242825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:34.245728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:34.294432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162988-b0e8-4c33-be2a-1d8dfd40f62d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.358709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 242/487] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:34.365326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.365982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.366270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.366547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.367250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:34.367554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:34.369115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:34.383597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 246/488] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:34.390019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.398981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.576466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:34.608933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007ca6c-02c0-4baa-b2f7-eb3d78c1ad75 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.616357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5384a0-d4a8-42a4-a5b4-c4f9db5f7afd None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.656170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.656916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.657282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.657607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.668641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:34.668934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.669934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.670408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.670697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:34.671069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.673881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:34.691686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cbd76f1c-dc82-4e8f-ba1f-5fe6b5ba9362 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:34.692099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:34.693107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:34.694162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:34.699277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:34.700479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:34.701402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:34.703957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 243/490] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:34.705899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181941-85b8-4ae5-94ef-8254c8622ee1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.713724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 247/490] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:34.713902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181941-85b8-4ae5-94ef-8254c8622ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.713902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181941-85b8-4ae5-94ef-8254c8622ee1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.714034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.714102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 244/491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:34.715668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181941-85b8-4ae5-94ef-8254c8622ee1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.832136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181941-85b8-4ae5-94ef-8254c8622ee1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.859636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d542-ad9f-42ec-979a-2adfbf1e1662 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:34.868081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.868981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.869269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.869585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.870346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:34.870658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:34.872046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc46a79-a234-4dc0-adf8-90e412f875b4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:34.881158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 245/492] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:34.882467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.882761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.883044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.905416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:34.906141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:34.906687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.907361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.907476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:34.907892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.908847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:34.909296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:34.910928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b314-1292-41b9-bf0a-c691f6b06750 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:34.913192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:34.959609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 248/493] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:34.961256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a5af8-feac-499c-88f3-5abe04349453 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:34.961638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a5af8-feac-499c-88f3-5abe04349453 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:34.962086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a5af8-feac-499c-88f3-5abe04349453 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:34.968510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 249/494] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:34.968510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a5af8-feac-499c-88f3-5abe04349453 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:34.979875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.001776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 246/495] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:35.001776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.091234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a5af8-feac-499c-88f3-5abe04349453 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.115105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31b62-b28b-444e-a576-723ff9901293 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.130698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.131373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.131785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.132222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.143988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.145542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.156389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.157018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.157295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.157573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ee222747-5812-4a00-82ec-c6b4b2c976b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:35.161673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:35.162569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 250/496] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.164466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.185425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:35.187143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:35.226422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.232425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.236848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.238733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.265512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 251/497] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:35.266701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.376278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eef81-028a-4d79-bf01-c7bb99d94657 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.387160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 247/498] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:35.387160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.427506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.428155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.428437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.428710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.443338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:35.448933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:35.449872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:35.450680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 252/499] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:35.451343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.491622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.500835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.517921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3321-9c53-412c-8c7b-51f775ba2c05 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.555124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.556267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.556715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.557002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.557716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:35.558052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.559448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.565245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37144a6-6067-43e3-aa50-5273b86305f7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.579305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 248/500] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:35.580768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.608889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.609534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.609850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.610130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.621677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:35.626707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:35.627847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 253/501] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:35.631048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.704424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e501f-68da-4911-be46-44983410d0c6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.740640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.741307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.741590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.742004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.750685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.754157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.755646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.758089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7f58-e2ba-40fc-bd4f-fd9d4ae629bd None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9c163e5a-623c-404d-bd41-bd4d1c239632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:35.774068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:35.775843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:35.776894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:35.776894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:35.776894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:35.776894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:35.777470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 249/502] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:35.779853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b002-0cdd-4d01-8c42-3cbd94c83ca4 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.780159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b002-0cdd-4d01-8c42-3cbd94c83ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.780549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b002-0cdd-4d01-8c42-3cbd94c83ca4 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.782418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 250/503] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:35.783210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b002-0cdd-4d01-8c42-3cbd94c83ca4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.787343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:35.807823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.808455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.808738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.809011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.809800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:35.810091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.811701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.820749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 254/504] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:35.822196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.900090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b002-0cdd-4d01-8c42-3cbd94c83ca4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.929457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dab62-522c-4c87-abf6-732555ee0310 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:35.935524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.936177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.936459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.936734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.944676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.946202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:35.958523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:35.960046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 251/505] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:35.961160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:35.969033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:35.969660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.969974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.970252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:35.971007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:35.971316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:35.972709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489c34b-927b-4410-9c49-ae6285f9fcbe None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:35.981342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 255/506] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:35.982706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:35.983026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:35.983307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.001386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:36.002634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:36.017512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.028401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.068808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2267e1a-1d6a-4685-a943-b064c60a1424 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.073716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 256/507] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:36.074598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.106018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.106656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.106942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.107226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.107932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:36.108243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.109625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.123058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 252/508] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:36.123907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.193590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b626d9-1880-44e6-9b04-f4dea69b794c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.227246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016489b-ea19-4900-97de-d383e47b7bde None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.230765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.231416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.231703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.231980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.242430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.244454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.253006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.253770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:36.261454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:36.268915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 257/509] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:36.269804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.270133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.270133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.270133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.270133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.270380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:36.270380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.270380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.309950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 253/510] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:36.310877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.366590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ede6f-f420-44f7-988b-8e6c394f7092 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.403341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.404016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.404252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.404534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.416121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.417525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.421743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6e61-2481-4b46-b03f-befda3100039 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:36.432947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:36.434221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:36.435090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:36.435090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:36.435090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.435090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:36.435090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 258/511] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:36.435365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.463840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.464416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.464700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.464975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.475367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.476849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.489307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:36.492362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:36.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 254/512] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:36.495069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.527511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.546706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae61e-7b9b-4340-955c-e353cd5a3c81 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.581155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.581828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.582115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.582396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.589173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.590658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:36.603434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:36.604348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:36.605178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 259/513] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:36.605640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.609891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad5f4-d109-4b67-b03b-6c48538ad9e8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.648788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.649642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.649955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.650230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.650997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:36.651336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.652781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.666816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 255/514] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:36.667673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.713990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b227-1c32-47db-b1ac-543f01ff6d27 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.729080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.752567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.753207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.753495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.753790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.813485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.822318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77069d9-5e8f-4511-b428-0e17704d16a5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:36.825099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.831168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.857467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:36.858242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:36.858524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:36.858794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:36.859481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:36.859845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:36.861701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:36.875503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 256/515] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:36.876350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.945728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 260/516] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:36.946937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:36.966034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:36.992708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58bcdd-402a-4ae6-b43f-da43bac8eb71 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.028477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.029107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.029393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.029672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.030410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.030715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.032145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.045183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 257/517] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.046069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.060999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.062961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c0480-33be-4931-9465-1a418cdc5b2d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.097863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.098489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.098780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.099065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.099819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.100137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.101604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.120459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 261/518] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.121312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.152100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1096-fdba-4f4a-879b-1cf10809bcc9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.186979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.187631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.187920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.188202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.193064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.195642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.197215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:37.210306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:37.211283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:37.212727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 258/519] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:37.213288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.228432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca310b2-2d0e-4e38-8227-bb8f19b13100 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.263745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.264409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.264700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.265004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.273184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.275640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.288570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:37.288919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:37.289885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:37.291042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:37.294767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 262/520] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:37.295685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.323114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07967c-a624-4593-b59c-f382362af839 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.360438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.361085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.361366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.361641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.372543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.374028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:37.388938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:37.389874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:37.390743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:37.390743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:37.390743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:37.390743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:37.390743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 259/521] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:37.391007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.404248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f884b6-dd42-41a8-bbd1-5afdea47e483 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.433922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.438963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.439609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.439926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.440208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.440928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.442458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.497769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfd527-9fdb-4c71-89f6-6fc612d1be08 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.521819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.533479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.534132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.534424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.534700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.535546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=a7c38ed92e03418ebf01b62f99a897c2) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.535859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.537307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.543299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 260/522] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/role_assignments?user.id=a7c38ed92e03418ebf01b62f99a897c2&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.544144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.573788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 263/523] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:37 2022] POST /identity/v3/users => generated 247 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:37.573788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.690325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c32b8-3acd-4f38-b94e-182781ca3030 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.733437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773af31-8170-4d51-b28d-590ed4a85136 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.739138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.739788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.740072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.740352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.741237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.741558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.743659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.772638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 261/524] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.772638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.776109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.776753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.777039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.777317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.778182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.778494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.781862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.801169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 264/525] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.806419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.844541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.865485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:37.913092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa456cf-9fb4-449a-86b1-f21244bb19cd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.940972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21736b-1305-4237-a762-63320ccb4267 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:37.953912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.954849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.955371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.955823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:37.956690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:37.957167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:37.958890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:37.972779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 262/526] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:37.974082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:37.994955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:37.995750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:37.996203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:37.996548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.075518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.077075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.124615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37234-0dd2-48a4-8891-67deb2510739 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:38.132454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:38.138281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:38.178633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:38.179572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:38.180100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:38.181808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.206305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 265/527] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:38.207057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:38.275559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.278175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.370324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5ffc-d542-4806-9edb-4aabb8b7b5a3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:38.418695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 263/528] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:38.419920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:38.429973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:38.470948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:38.471489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:38.471717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:38.471934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.491058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.492548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:38.526767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:38.527711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:38.528546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:38.538725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 266/529] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:38.539691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:38.546847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ede90-3b30-487f-9981-c15d4a190200 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:38.559775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:38.630622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:38.631643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:38.632127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:38.632609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.648662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.650844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:38.682822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:38.683749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:38.684608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:38.684608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:38.684608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:38.684608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:38.693063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 264/530] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:38.694330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:38.756102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253f84f-4f14-439b-9705-7153285e3440 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:38.842001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:38.859238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:38.860025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:38.860377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:38.860718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.879347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.883197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.903729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc8f59-ae06-4a4b-8e69-7884584e9b0c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:38.908672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:38.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:38.910400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:38.910400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:38.910400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:38.910400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:38.915658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 267/531] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:38.916821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:38.964933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:38.965637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:38.965957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:38.966236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:38.967025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:38.967338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:38.968777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:38.993261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 265/532] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:38.995189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.004826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.062468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679695-d0cb-4749-aa32-352aa2d8af13 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.101511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.103297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.103825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.104353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.105617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.106234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.108853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.128027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 268/533] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:39.128027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.128272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882c243-e868-441b-8bca-6f3af5b5432f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.151042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.170503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.171100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.171388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.171665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.175453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.175453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.175453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.191543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 266/534] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:39.191543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.272341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1cdd-7464-4027-8d43-51245371bd53 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.297368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.318766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.319651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.320135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.320556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.321565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.322067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.323698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.332139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 269/535] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:39.333220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.418351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051256a-8dc5-45c5-82e9-a541dc358e5e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.460988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25931-7974-48ea-b7ec-f4462b8b7563 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.504311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.505689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.506352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.506796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.516918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.518894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:39.533507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:39.534731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:39.535747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:39.542227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 270/536] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:39.544461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.550860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.551843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.552271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.552686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.583864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.586312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.602715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:39.640610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:39.641564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:39.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:39.644376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 267/537] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:39.654567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.673986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1bb0-7d0d-433d-b896-43740c47c28e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.723497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.733547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.734228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.734520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.734800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.735778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.736096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.738000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b59b-0516-4b1e-8d85-a13124a01ddb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.761397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 271/538] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:39.761397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad59f23-51a3-4f24-927a-9481955ed90f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.761397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad59f23-51a3-4f24-927a-9481955ed90f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.761397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad59f23-51a3-4f24-927a-9481955ed90f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.761397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 272/539] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:39.765410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad59f23-51a3-4f24-927a-9481955ed90f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:39.815722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce81fb-79c0-4f71-8cb3-e4c38e2768de None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.855248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82496405-4279-4234-a089-d566e557853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.856156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496405-4279-4234-a089-d566e557853e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.856684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496405-4279-4234-a089-d566e557853e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.857105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82496405-4279-4234-a089-d566e557853e None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.858185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496405-4279-4234-a089-d566e557853e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.858647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496405-4279-4234-a089-d566e557853e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.860409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82496405-4279-4234-a089-d566e557853e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.886237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 268/540] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:39.888521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.889117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.893768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.900448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad59f23-51a3-4f24-927a-9481955ed90f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:39.902577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:39.916565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:39.918171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:39.951682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:39.952710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:39.953103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:39.953488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:39.954709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=736ade5de27a48319e720a6f968c0239) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:39.955579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:39.957720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:39.973745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 273/541] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/role_assignments?user.id=736ade5de27a48319e720a6f968c0239&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:39.973745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.036354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 269/542] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:40.073619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.094178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef89b0-891a-4835-95f5-43c510f40cb2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:40.141907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:40.142711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.143346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.143707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.145077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:40.146341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=b789d4e183f94b22b09e491728614fd2) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:40.146835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:40.148944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743e7ca-6fae-41d6-ae1b-a0c16cdabb57 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:40.156557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 274/543] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:39 2022] GET /identity/v3/role_assignments?user.id=b789d4e183f94b22b09e491728614fd2&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:40.217036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b1fd-fe47-4c5f-847a-eab40c16d2fe None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.217662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b1fd-fe47-4c5f-847a-eab40c16d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.218223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7b1fd-fe47-4c5f-847a-eab40c16d2fe None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.220287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 275/544] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:40.226825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.228001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.228502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.258911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:40.261062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:40.287290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6c65-9708-45a2-8d94-4921c93cc7c8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:40.305223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:40.352310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:40.353539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.353862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.354145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.372118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:40.382295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:40.383415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:40.384374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:40.385278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 276/545] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:40.387220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 270/546] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:40.394935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.411223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.583906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:40.597652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d725-fb68-4001-93ac-99c4c431f198 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:40.614267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6712-df5e-4cf7-a7ac-6d90e41209ae None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:40.664001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:40.665205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.665701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.666830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.667952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:40.668749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:40.671397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:40.685247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 277/547] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:40.691007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.702496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:40.713047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.713047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.713047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.723654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:40.734874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:40.739839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:40.748347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:40.749172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 271/548] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:40.750894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:40.821890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5aa9-6183-402d-80fa-444d05e61189 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:40.863897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:40.864897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:40.866400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:40.866870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:40.879007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:40.881159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:40.900806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:40.901969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:40.903022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:40.903022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:40.903022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:40.903022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:40.905090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 278/549] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:40.911308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.019816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152e99c-fb7c-42f9-a524-ddaa0a7f4096 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.022418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:41.037260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8a6dd-7b31-4e03-91a6-50912bc6c507 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.080011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.080641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.080929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.081210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.081943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:41.082254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.083944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.097636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 279/550] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:41.103396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.127346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.127898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.128179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.128454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.129186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:41.129491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.130919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.153306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 272/551] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:41.157603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.182107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:41.264108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516adecb-3613-4c9d-8020-bf47716df0b4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.329428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.332983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.333268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.333544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.338294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:41.348518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.350012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:41.365215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:41.366614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:41.367524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 280/552] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:41.373011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.394637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18d2a-275a-4284-bed6-d3e025eca7c8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.474516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.475190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.475481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.475758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.492258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794a06d-c15c-4f17-8ace-9118ae33f03c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.496542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.498136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:41.524940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:41.526069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:41.526937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:41.526937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:41.526937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:41.526937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:41.526937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 273/553] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:41.534347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.534690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.535501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.535799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.536080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.536891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:41.537204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.538858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.559370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 281/554] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:41.565484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.630344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:41.722213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:41.741282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187007-8428-4517-8ff7-e5973f0dfaf3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.823148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503cc0-3c24-4190-9643-ac4f90458273 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:41.835676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.836772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.837346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.837963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.856955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.858790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ea35e0d0-1756-487d-9c62-5d070c03f400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:41.883659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:41.885066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:41.886470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:41.886470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:41.886470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:41.886470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:41.886470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 282/555] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:41.886756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed93-1dc4-4035-bed3-0fd2ef84e752 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.888089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed93-1dc4-4035-bed3-0fd2ef84e752 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.888089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ed93-1dc4-4035-bed3-0fd2ef84e752 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.889160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 283/556] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:41.890698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:41.891430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.891815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.892185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.892986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:41.893414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:41.894822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4cf0-825d-4b09-9564-2a701da07677 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:41.895900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ed93-1dc4-4035-bed3-0fd2ef84e752 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:41.911603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 274/557] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:41.913038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:41.913327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:41.913601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:41.936808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:41.938089 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:42.024515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 275/558] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:42.025290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.039599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ed93-1dc4-4035-bed3-0fd2ef84e752 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.043856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.088280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.089610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.090137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.090624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.091914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:42.093104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.095085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.100999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.113548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 284/559] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:42.115121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.174885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb85578-f643-490a-a222-fe86b54267d5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.225145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.225898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.226181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.226450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.237854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.239975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:42.255562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:42.256613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:42.258243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 276/560] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:42.259092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.270950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867c413-bf1f-47ad-811e-723fb1661650 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.309502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.310122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.310406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.310676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.322316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:42.327637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:42.328697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 285/561] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:42.330155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.359316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.382158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9a133-a0a6-41b7-9c8f-29091c3b6a7b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.397119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.422835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.423893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.424416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.424940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.433104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.436091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.443358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebbdd8-cbaa-4734-8ccd-fdd4b002f086 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:42.450123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:42.451044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:42.452026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:42.454694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 277/562] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:42.455941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.486763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.487422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.488175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.488457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.489279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:42.489592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.491094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.512919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 286/563] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:42.513801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.584573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcf39-dbe6-4c75-b2b3-bdfeefe9c856 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.615865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.623377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.628614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e88ea-274c-4dd2-affc-95963d9b388f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.636835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 278/564] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:42.638537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e2c6-660e-4cc1-82e0-fe5fb24ec286 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.639036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e2c6-660e-4cc1-82e0-fe5fb24ec286 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.639547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e2c6-660e-4cc1-82e0-fe5fb24ec286 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.643559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3d73-32e9-45ff-9df1-6a2908ec574e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.645182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 279/565] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:42.646017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067e2c6-660e-4cc1-82e0-fe5fb24ec286 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.685604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.687187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.688039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.688465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.688904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.689829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:42.690280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.691922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.706708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 287/566] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:42.707816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:42.797554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067e2c6-660e-4cc1-82e0-fe5fb24ec286 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.818828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85ca93-d59f-4caa-a38a-c28927150d5e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:42.831657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.832284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.832571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.832847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.855227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:42.855881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.856179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.856455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.867571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.869584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.871463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-7799bc05-80cc-4af7-930f-59593f24dcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:42.887701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:42.888777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 288/567] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:42.889667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:42.890445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:42.890445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:42.909048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:42.910546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89737c-6460-4a8f-bdad-b3842722f09d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:42.910951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:42.912165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:42.945264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:42.983119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 289/568] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:42.983383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.017521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 280/569] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:43.018846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7b18-5b49-4f95-a317-6d8a1dd51b52 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.019160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7b18-5b49-4f95-a317-6d8a1dd51b52 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.019427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7b18-5b49-4f95-a317-6d8a1dd51b52 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.024864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 281/570] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:43.024864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7b18-5b49-4f95-a317-6d8a1dd51b52 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.104211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0beba-8f5b-4e5b-89f9-bdf2a46b0692 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.130427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.132161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7b18-5b49-4f95-a317-6d8a1dd51b52 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.143014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.143700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.143984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.144269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/a7c38ed92e03418ebf01b62f99a897c2/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.159513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=a7c38ed92e03418ebf01b62f99a897c2, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.161026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.168736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.169359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.169640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.169944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.170635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:43.170936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.172319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.175319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.185355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 282/571] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:43.186113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.230484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 290/572] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:42 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/a7c38ed92e03418ebf01b62f99a897c2/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:43.231427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.301601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63180-2219-4930-920d-f9193e6ea13a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.360191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.361310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.361775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.362086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.371716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce609-060e-4be2-885a-606400a06c17 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.378352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3b6a0f0e-49a3-4ad6-8dce-f6ebbb544c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:43.385921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:43.394800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 283/573] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:43.396840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.398619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.398619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.419379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:43.420601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:43.432827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.434514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.434981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.435525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.453299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.455641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:43.481598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:43.482745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:43.483633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:43.483633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:43.483633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:43.483633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:43.485840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 291/574] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:43.486944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.501404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.519650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.533795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 284/575] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:43.533795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.616240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5ebf-6a98-4797-a6eb-05c2d7945fb0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.651065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ca1bf-4989-4578-87e7-8cd43f426e23 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.653839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.654573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.654864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.655140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.664796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.666876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:43.680712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:43.681877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:43.682810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:43.685076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 292/576] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:43.685925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.694008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.694639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.694923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.695202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.697857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:43.697857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.698270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.713741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 285/577] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:43.713741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.790707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.790973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:43.807774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77914122-02c8-4807-9dca-1cd36b985573 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.847306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.848658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.849199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.849199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.849937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:43.850243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:43.851625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:43.852296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93033e14-6609-41f7-a276-e76f557f7ea9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:43.864887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 293/578] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:43.870615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.892198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:43.892844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:43.893169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:43.893403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:43.905614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:43.910849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:43.911814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:43.912704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 286/579] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:43.913420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:43.991311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b48660-d93f-4760-8f90-215281fcbdb1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.036150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84baf87-4452-4cf3-8e38-dc22c1047f92 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.036385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.037052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.037343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.037656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.038451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:44.039456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.040288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.045538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.058684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 294/580] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:44.059449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.064271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.081295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.081980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.082266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.082579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.095075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.097028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:44.112477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:44.113489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 287/581] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:44.119237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.195219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0bf63-45f5-4478-9bd8-71027fed313e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.234679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.235341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.235625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.235912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.241049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a39c3-79b9-479e-b093-89cba560c910 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.243397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.245101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:44.258322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:44.260397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 295/582] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:44.261504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.289959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.290689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.290989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.291261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.291996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:44.292304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.293687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.313842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 288/583] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:44.314794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.334433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.341185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.381977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae4c-d42e-406e-a5c7-887c56a7eaf3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.422906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.423553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.423839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.424112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.436722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80492cb6-9ec3-43cc-a591-b6b4e89cc21d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.438102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.439767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:44.456345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:44.457285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:44.458323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:44.458323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:44.458323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.458323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:44.458323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 296/584] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:44.458617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.491198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.491821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.492106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.492380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.493609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:44.494014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.495390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.508325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 289/585] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:44.510061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.593876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97b52-e5d4-4325-8000-7722f83f3a96 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.611025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.620668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.629459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.632906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.632906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.632906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.632906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:44.632906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.633583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.646355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ecbb1-c767-4de7-bda4-84197e2a233e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.650335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 297/586] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:44.651925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.685294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.690379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.690379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.690379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.700011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.701526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:44.718251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:44.719176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:44.720159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:44.720159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:44.720159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:44.720159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:44.724068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 290/587] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:44.730382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.786220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0599-8fc5-41de-bdb5-30688e589a06 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.833298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.834244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.834694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.835121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.835970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:44.836423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.838819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.855811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 298/588] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:44.857230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.869442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7699-aece-45c0-aee3-c7081c859653 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:44.900745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.906331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:44.907011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:44.907317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:44.907581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:44.908207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:44.917061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:44.919254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:44.932477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:44.933613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 291/589] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:44.935181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:44.995634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8365b-95c4-4642-a48e-784e30d41fe0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.047674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.048704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.049277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.049933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.050823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=2e5baeab919f40e2b92f155a0c34d8d8) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:45.051140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.052724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.069790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 299/590] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/role_assignments?user.id=2e5baeab919f40e2b92f155a0c34d8d8&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:45.069790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.082099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508daff1-2172-467e-b635-6f96fe7dcec4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.127438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.128277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.128629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.128990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.129903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:45.130282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.131751 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.147031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 292/591] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:45.148247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.204350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:45.207987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456adad5-bb84-4728-8f4c-488445e4d978 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.244494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:45.251583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.252319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.252663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.252997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.263518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.265074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:45.280390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:45.282366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 300/592] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:45.283756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.328621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32826f46-5313-4982-a3c0-35ee7ccba34c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.390022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.390668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.390953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.391231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.392186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:45.392496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.394237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.417588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 293/593] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:45.418625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.440429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9ed7-8a07-4bb1-9d26-b2a4168e7ebe None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.488366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.489030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.489310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.489564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.498017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.499500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e8f07486-a3b9-417e-a7ac-7d0b18ab631d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:45.513297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:45.520060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 301/594] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e51-566c-4122-9ed9-7fb45ec4b10f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.521007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e51-566c-4122-9ed9-7fb45ec4b10f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.521735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5e51-566c-4122-9ed9-7fb45ec4b10f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.521735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 302/595] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:45.521735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5e51-566c-4122-9ed9-7fb45ec4b10f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.545606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:45.563309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e30e5-f050-435e-9d17-cb57b2c5d2bb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.584781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:45.620382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.621322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.621611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.621971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.622742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:45.623097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.624565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.638385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 294/596] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:45.639126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.655348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5e51-566c-4122-9ed9-7fb45ec4b10f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.700602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.701319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.701603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.701989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.714689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.716148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-fb958636-64be-4e7c-b256-59fcb4194f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:45.734048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:45.740315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 303/597] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.741415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.765581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:45.766267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:45.799266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e65737-bbf8-425a-bb42-f8ffcb598b13 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:45.850599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:45.851829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:45.852295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:45.852931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:45.854120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:45.854684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:45.856950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:45.862324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 304/598] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:45.863440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.866258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:45.900909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 295/599] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:45.902137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:45.944636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.026886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2d657-9cb6-4531-8189-c9e0a40e9e35 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.056009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4980b5-33eb-4bc1-9c44-73351013f711 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.074947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.075642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.075942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.076213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.093371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=4b73ce0aeb0846d88bf3e4b21405eda3, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.094861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.095730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.096365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.096654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.097029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.097684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:46.098012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.099478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.112545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 296/600] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:46.113403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.183702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 305/601] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:45 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:46.185080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.237369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.269330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eca2b-f23a-4076-ba52-2ddc4e91b5ee None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.298081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.314327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.314999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.319311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.319311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.329425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:46.335313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:46.336346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 297/602] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:46.337871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.361054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a602-2349-4778-88dd-8f15cefee3c5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.425430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.427402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.427704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.427986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.441574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.443390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:46.467339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:46.468329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:46.469367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:46.469367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:46.469367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:46.469367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:46.473450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc501ee-0b04-40bb-a47a-efba59bfb598 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.476014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 306/603] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:46.477123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.521361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.522255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.522552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.522798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.532473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.534146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:46.546927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:46.548060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 298/604] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:46.549251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.567275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.624550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f4e4c-a486-43c9-b9ea-bdcf1f480efa None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.628433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.664675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.665945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.666216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.666490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.667240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:46.667586 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.669217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.678553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 307/605] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:46.679718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.699625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff4ca-c539-40d2-9dad-72665c3351b2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.751407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.753622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.754348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.755333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.757512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:46.758079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.760712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.788573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 299/606] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:46.788573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.824792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5923-fedd-47f6-8110-5bd76ca8cced None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.872283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.872935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.873265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.873639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.874524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:46.874988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.876570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:46.886630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.898059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 308/607] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:46.900573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:46.934868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978935f-5805-4038-9e8a-a57638164669 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:46.950188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:46.980649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:46.981585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:46.981934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:46.982385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:46.994482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:46.996264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:47.013776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:47.014992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:47.016086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:47.016086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:47.016086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:47.016086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:47.022000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 300/608] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:47.022000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.053973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27945-218d-4fbc-b6bb-8db676551ff0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.106277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.107591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.108696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.109206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.119140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.121016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:47.141145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:47.142271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:47.143785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:47.152686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 309/609] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:47.152686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.166652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d0c8e-fdfe-42c9-86a8-223232d50c16 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.194054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:47.216192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.217850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.218654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.219207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/736ade5de27a48319e720a6f968c0239/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.245403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=736ade5de27a48319e720a6f968c0239, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.247958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266cdc0-1ce5-46e9-8cfc-aa4a903437e8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.256477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:47.273544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49209fe-1770-4792-83a4-1013c21387c4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.313098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.313728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.314052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.314331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.315031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:47.315334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.316806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.329589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 310/610] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:47.330470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.353244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 301/611] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:47 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/736ade5de27a48319e720a6f968c0239/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:47.362054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c709-4c6d-4a04-b1fd-9da9cd78f152 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.362054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c709-4c6d-4a04-b1fd-9da9cd78f152 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.362054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7c709-4c6d-4a04-b1fd-9da9cd78f152 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.362054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 302/612] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:47.362054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7c709-4c6d-4a04-b1fd-9da9cd78f152 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.486256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41c22-9390-4f47-8842-625a625af0cd None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.506527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7c709-4c6d-4a04-b1fd-9da9cd78f152 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.536417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.537125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.537411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.537702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.538543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:47.538901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.540722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06072f-1231-4da7-85f5-199f4aa37f04 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.556279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.556976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.558880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.558880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.561449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 311/613] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:47.563190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.563695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.564173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.569342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.570853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.580773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:47.585326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:47.586283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:01:47.587582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:47.588668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 303/614] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:47.589438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.590847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:47.592279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:47.632995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:47.667452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 312/615] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:47.672722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.715381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8078aa-efc4-4a8b-91bd-f4f37bd13bdb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.757081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.758356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.758757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.759183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/b789d4e183f94b22b09e491728614fd2/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.779312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=b789d4e183f94b22b09e491728614fd2, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.781246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.813528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa97f8-5f3a-452e-a10c-958dd5e9a6f5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:47.850186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:47.850812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:47.851109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:47.851371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:47.852169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:47.853191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:47.854920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:47.862823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:47.887060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 313/616] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:47.887060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:47.946118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 304/617] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:47 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/b789d4e183f94b22b09e491728614fd2/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:47.948106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.047186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54a7b-92cc-499d-be7c-7381b1f12d29 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.091759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.092643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.092930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.093499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.106659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:48.112822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:48.113849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:48.115373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 314/618] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:48.121533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.163615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.185184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c2ba0-9421-4b48-8f41-aaf994b4e9cc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.218131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.226304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.226945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.227231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.228062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.266345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3e22-cf64-4c22-adc6-a322e58c98c3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.306364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.307864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.343113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.344152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.344657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.345139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.346132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:48.346669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.348293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.368144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 315/619] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:48.378820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.397185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.421503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 305/620] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:48.427769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.547926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad705dbf-c127-4cca-9bd5-d591e8ee3800 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.558157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a33f-b8a6-483c-8bc2-743397944179 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.569301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.598224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.599921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.600702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.601149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.603712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.604416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.604701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.605082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.617142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.617606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.619320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.620657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-99503f2d-c4bc-4077-9c2d-b17dec7db654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:48.637861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:48.639041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:48.640152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:48.640152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:48.640152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:48.640152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-520ec64b-fff8-4d2f-8828-f95aee74eb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:48.642935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:48.643817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:48.644854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:48.644854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:48.644854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:48.644854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:48.645074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 306/621] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:48.645144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885be2-e994-4a74-8bef-4c21cfc729fd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.645401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885be2-e994-4a74-8bef-4c21cfc729fd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.645683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63885be2-e994-4a74-8bef-4c21cfc729fd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.651965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 307/623] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:48.651965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63885be2-e994-4a74-8bef-4c21cfc729fd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.652281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 316/623] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:48.654847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.655324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.655815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.688629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:48.690263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:48.696236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.787824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 317/624] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:48.788951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63885be2-e994-4a74-8bef-4c21cfc729fd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.789459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.835380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.836033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.836318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.836595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.837550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:48.837890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.839258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.856828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 308/625] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:48.862073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:48.907744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.912494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316917fe-f8ca-4eaf-a4b2-35add22a175c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.952831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:48.953939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:48.954445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:48.954918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:48.955927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:48.956656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:48.958318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:48.963783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:48.972693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8587e4-518a-4868-929c-3c1b55c26f03 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:48.977328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 318/626] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:48.979091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.014042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.014836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.015076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.015356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.027339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:49.032584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:49.033511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:49.034384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 309/627] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:49.035079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.108669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc0ea-570e-48c6-ad9a-883cd48027de None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.148793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.149329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648e97-14be-4875-a93f-925940722ffb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.150549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.151118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.151717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.159495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.161377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:49.175017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:49.176059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:49.176953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:49.179297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 319/628] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:49.180377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.191115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.191777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.192061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.192339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.202426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.204075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.206558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:49.217624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:49.218651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:49.219601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:49.223811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 310/629] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:49.224747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.242266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.304317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6c48-f244-4eb7-a10d-f97f8fb9bf98 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.341627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6b27-140c-40d2-b9df-0e6dc8f679d2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.344550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.345363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.345818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.346235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.347130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:49.347592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.349232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.359997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 320/630] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:49.361278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.385623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.386362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.386646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.386925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.388216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:49.388216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.389698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.404223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 311/631] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:49.409933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.455873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.479191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a749c-1efd-49e6-9224-65ee4e894305 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.499709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.520458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.521483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.522009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.522487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.523536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:49.524044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.526380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.531431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413b4d-ff34-4f15-9276-db4517097617 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.548821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 321/632] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:49.550128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.577907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.578567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.578853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.579128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.591007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.592579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:49.609092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:49.610129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:49.611155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:49.611155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:49.611155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:49.611155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:49.611155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 312/633] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:49.611498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.677251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53ccd-3c7b-4d36-9fd1-a380ff8146d0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.722847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.723410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.723693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.723970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.724784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=a7c38ed92e03418ebf01b62f99a897c2) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:49.725095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.726716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb3e96-7ca5-47d7-9e46-06856a8e1c58 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.734963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 322/634] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/role_assignments?user.id=a7c38ed92e03418ebf01b62f99a897c2&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:49.736241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d01d-845b-424d-b961-2b85208333c8 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.736589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d01d-845b-424d-b961-2b85208333c8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.736809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d01d-845b-424d-b961-2b85208333c8 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.738260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 323/635] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:49.738774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d01d-845b-424d-b961-2b85208333c8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.742093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.765959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbf926-6f63-4d12-82fe-1e2293a79587 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.806884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:49.829860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.831000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.831284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.831767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.848487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.850319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8e5afef5-c7de-4f71-91bf-db07919ec98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:49.868306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:49.869466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:49.870541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:49.870541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:49.870541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:49.870541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:49.876901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 313/636] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:49.878747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.879246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.879708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.882288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d01d-845b-424d-b961-2b85208333c8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:49.901533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:49.903394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:49.927192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:49.927826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:49.928092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:49.928368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:49.929071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:49.929374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:49.931088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:49.949732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 324/637] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:49.950709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:49.991554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 314/638] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:49.993066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.068036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.136540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b8681-1853-4bb4-a9c6-90de6ac15c68 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.151001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68444-3025-4151-b151-cf05879c1ae7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.160978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.176632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.177261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.177544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.177935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.178643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:50.178943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.180325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.194418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 325/639] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:50.195279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.199735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.200859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.201631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.202432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.212954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.214811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:50.229550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:50.230600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:50.231561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:50.238662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 315/640] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:01:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:50.240022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.342949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628ade6-8198-4946-8380-24acaa74d3fb None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.366731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b9143-7099-435f-9c00-5a4345dd3ccc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.371310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.385787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.386920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.387273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.387550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.406685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:50.417419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:50.418718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:50.419807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:50.420678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 326/641] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:50.421318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.427613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.428279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.428567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.428849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.442648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.445146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-dd9ebbc7-91e1-404f-b0d5-2d109f29f491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:50.465262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:50.466292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:50.467366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 316/642] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:50.467877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd519f8-b4b5-4e66-a6c8-bff18a489ed9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.467965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd519f8-b4b5-4e66-a6c8-bff18a489ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.468495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd519f8-b4b5-4e66-a6c8-bff18a489ed9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.470513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 317/643] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:50.474635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd519f8-b4b5-4e66-a6c8-bff18a489ed9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.515322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.562077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14ae1-651e-40eb-bffd-acd40507ab2a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.601707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd519f8-b4b5-4e66-a6c8-bff18a489ed9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.601944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.602366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.602716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.603196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.603973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:50.604279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.606460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.632104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 327/644] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:50.632104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.652951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.653582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.653900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.654235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.654899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:50.655203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.656567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c663b-319d-42dc-91b9-8b7ab6046234 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.665533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 318/645] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:50.666921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.667214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.667495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.681977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.693578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:50.697219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:50.769533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621831-e9de-4447-999a-b1fc0a5b3397 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.787780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 319/646] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:50.798676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.816893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.817528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.818365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.818554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.819829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:50.820364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:50.822745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.822888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:50.839386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 328/647] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:50.840666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:50.923886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfaf1f-5b4f-49b7-ace7-4e074da2d3ab None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.953998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:50.957931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833481a4-fff6-4f9f-b4de-9a011c830aa4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:50.964747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.965385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.965668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.972174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:50.997855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:50.998922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:50.999427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:50.999921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.018667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.020558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:51.041861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:51.042948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:51.043832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:51.043832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:51.043832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.043832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:51.043832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 329/648] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:51.044133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.060344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.061875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.082679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.165323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cd243-b1fb-4613-acf8-74d29c92c26e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.185350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 320/649] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:51.186466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.213326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.214039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.214474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.214894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.228225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:51.233818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:51.235032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 330/650] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:51.236639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.258086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.316350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b25a-f60c-44b8-975b-430d32078d1e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.343670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.359020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.360016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.360302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.360836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/2e5baeab919f40e2b92f155a0c34d8d8/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.367511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50fbe-0835-421d-9c88-6740378957f1 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.377999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=2e5baeab919f40e2b92f155a0c34d8d8, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.379443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.407494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.408121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.408402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.408676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.409368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:51.409673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.411085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.425459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 331/651] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:51.426358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.461927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 321/652] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:01:51 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/2e5baeab919f40e2b92f155a0c34d8d8/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:01:51.461927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.541475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.585979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb21ebd-68d5-4224-bbcf-9695174ac3fb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.588174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cd6d-ce98-4fe4-9275-c3a0dfd67192 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.640909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.642622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.642969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.643637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.643804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.644004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.644408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.644919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.646035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:51.646548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.649884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.658813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.659881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.664251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 322/653] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:51.666362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:51.676969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:51.678345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 332/654] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:51.683828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.712490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.820026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68be2-9624-45c7-8671-16dbc15d9366 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.834580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd5d6-3657-454d-80fd-60d84b35c7d2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:51.867563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.869708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:51.870934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.871475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.871987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.882220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.882398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:51.885992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:51.885992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:51.885992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:51.886234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.900666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:51.902039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:51.902872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:51.903776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:01:51.904698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:51.913032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 323/655] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:51.914200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:51.921548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:51.923195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:51.924608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:51.924608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:51.924608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:51.924608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:51.928393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 333/656] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:51.929397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.039134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.048916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d9408-8902-4b6f-b136-0d2aa3d2a0a1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.089566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1520479-4be3-4a2e-83b0-986bd69759c0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.097841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.099094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.099619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.099994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.100789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:52.101201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.103957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.122777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 324/657] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:52.122777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.133322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.134262 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.134879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.135258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.136178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:52.136587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.138165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b34e0-0447-4d65-aa67-7970d5093c66 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.157681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 334/658] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Aug 1 14:01:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:52.158985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362fc-c340-45f4-aaa8-29379b1c586d None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.159275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362fc-c340-45f4-aaa8-29379b1c586d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.159603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362fc-c340-45f4-aaa8-29379b1c586d None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.162590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 335/659] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:52.166812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102362fc-c340-45f4-aaa8-29379b1c586d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.217546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.261672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81d30-690d-47e8-9195-11a023e2808c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.298891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102362fc-c340-45f4-aaa8-29379b1c586d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.302323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.303071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.303448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.303816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.304604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:52.305004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.306915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.319399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 325/660] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:52.320551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.340686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.346274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.346722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.347160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.347522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.355546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.357256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-6a55db00-6be5-49eb-bf0f-3d4439d5e6f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:52.369939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:52.371643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:52.373209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:52.378513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 336/661] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:52.379930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.380211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.380485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.409347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:52.411267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:52.454492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735da95-01fe-4d66-97db-3a62719b5cf9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.493836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 337/662] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:52.493836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.505381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.506408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.506965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.507458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.537774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.594725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.596197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.608020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.630994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd119c0-c915-43bc-b6e0-746ca51db9a6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.672087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.672751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.673021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.673301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.681732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.683240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:52.695941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:52.697782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:01:52.698866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:52.702852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 338/663] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:52.704174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.727010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 326/664] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:52.728384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.816548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.837627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecdb78-0c71-440f-9f5f-b0a61e7b4bf5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.857982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08323647-42aa-4f49-b971-e7742a131a21 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:52.871791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:52.876843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.877477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.878074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.878221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.878970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:52.879277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.880717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.893906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 339/665] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:52.894765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:52.907223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:52.908324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:52.908780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:52.909200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:52.922970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:52.924708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:52.942851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:52.943995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:52.945191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:52.945191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:52.945191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:52.945191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:52.947153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 327/666] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:52.948218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.034230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401256e4-ff61-48e1-8fbb-53325dc555e9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.076629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.077264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.077553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.077863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.078680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:53.078996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.081168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.081737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962838c-4e8a-4c38-8cf8-8c1834c50efd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.104512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 340/667] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:53.105378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.112907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.130535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.131795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.132253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.132692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.165828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.167734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:53.185682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:53.186833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:53.187972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:53.187972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:53.187972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:53.187972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:53.189769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 328/668] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:53.190921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.216724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.250744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf083c-0f9f-4097-81d4-05b1ecd4cbbe None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.290794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.291537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.292201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.292201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.292911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:53.293226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.294706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.301284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 341/669] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:53.301978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.326151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6c8-0e95-452e-b5a8-4582be6978ec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.382923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.383852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.384953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.386006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.386321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.387081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:53.387394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.388824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.407891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 329/670] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:53.409169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.438704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870bf7b-17c3-401f-9bff-6c402bf9891d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.478497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.479234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.479594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.479884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.529422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.559361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4880fa-cfe4-48ef-b210-facf372dbadb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.565735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.567239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.612897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.613608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.613932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.614215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.614926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:53.615236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.616626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.629364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 330/671] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:53.630104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.657251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.707856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 342/672] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:53.709059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.772237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626515-e58a-4347-ae4a-e12539b95aa1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.809652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.810619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.810970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.811247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.811933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.813392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.822249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:53.827909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce62b9-5fd9-4c89-8387-f87e42d076cf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:53.862164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:53.862814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.863102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.863382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.870814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:53.872278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-08cb3901-d9c7-4f71-a0e4-d43d94821a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:53.886711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:53.887671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:53.888582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 343/673] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:53.889063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff88e-a415-45cd-aa2a-d804477cf9cf None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:53.889571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff88e-a415-45cd-aa2a-d804477cf9cf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:53.889671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff88e-a415-45cd-aa2a-d804477cf9cf None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:53.891271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 344/674] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:53.891647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff88e-a415-45cd-aa2a-d804477cf9cf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.919292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 331/675] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:01:53 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:01:53.919292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:53.933659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.034771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff88e-a415-45cd-aa2a-d804477cf9cf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.080602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.081271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.081558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.081944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.094930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.096836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.098912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50580279-308c-4369-aba1-99d356cbcb92 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-946ea38a-cc5e-4799-a802-f36e4d73d988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:54.113797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:54.115093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:54.115984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:54.115984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:54.115984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:54.115984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:54.120311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 345/676] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:54.121790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1df308-d141-4519-a968-e93efba7636e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.122090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1df308-d141-4519-a968-e93efba7636e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.122381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1df308-d141-4519-a968-e93efba7636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.145125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0b1df308-d141-4519-a968-e93efba7636e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:54.146703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0b1df308-d141-4519-a968-e93efba7636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:54.153500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.153500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.154154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.154154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.154840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:54.155151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.157146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.174806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 332/677] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:54.175380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.241817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 346/678] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:54.241817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1df308-d141-4519-a968-e93efba7636e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.255515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.262893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.327054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a3a7-4537-4888-8f9f-0867bbb15f64 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.363240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1df308-d141-4519-a968-e93efba7636e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.372979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.374180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.374570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.375015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.376334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:54.376659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.378287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.402085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 333/679] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:54.403070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.409544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.410214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.410501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.410779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.411589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=736ade5de27a48319e720a6f968c0239) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:54.411904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.413350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.421243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 347/680] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/role_assignments?user.id=736ade5de27a48319e720a6f968c0239&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:54.422124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.512482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.544127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0aa07-6690-4a7e-ba0b-666b3e5fe905 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.612308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.613329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.613845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.614324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.631514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.637230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:54.666242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:54.667265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:54.668147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:54.670607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 348/681] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:54.678271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.695655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d351-5f5f-49f7-9e83-81fc6c932ad9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.713913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.747186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.747894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.748186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.748618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.770916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:54.778400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:54.779417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:54.780253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:54.787283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 334/682] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:54.794525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.819925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7406d63-0944-4bcb-b857-93d230825cfa None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:54.860367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:54.872116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:54.873010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:54.873275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:54.875154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:54.876013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:54.876395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:54.877891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:54.903195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 349/683] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:01:54.911036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:54.985027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90921e2-454f-48db-9459-95bdd4957341 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.034638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.035191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.035473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.035750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.036472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:55.036774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.038194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.058080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 335/684] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:55.069062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:55.116817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf56a6-7e09-475e-8808-01c1af1dffb5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.131811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:55.205455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.206119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.207432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.207721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.208535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=b789d4e183f94b22b09e491728614fd2) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:55.208849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.210344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.219375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 350/685] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:54 2022] GET /identity/v3/role_assignments?user.id=b789d4e183f94b22b09e491728614fd2&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:55.256383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35de2b-f5b2-4582-8397-dab4c603707c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.321896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.322546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.322886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.323181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.343953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.345448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:55.371847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:55.372838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:55.373769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:55.373769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:55.373769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:55.373769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:55.373769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 336/686] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:55.382331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:55.466918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:55.525238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37158f3-79f0-4964-b7fb-da51e42d980b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.564650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.565284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.565570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.565881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.566659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:55.566969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.568358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e008242-8908-480e-ad42-12df4fd67471 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.581844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 351/687] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:55.587086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:55.678757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:55.686807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a476-f2c4-42bd-be37-67401497c1f1 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.687471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a476-f2c4-42bd-be37-67401497c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.687634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a476-f2c4-42bd-be37-67401497c1f1 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.689325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 352/688] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:01:55.695746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.695746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.695746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.702350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ef33-5842-4e1d-a227-7bc558ab8df7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.728662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:55.729850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:55.744961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.746110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.746603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.747084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.755650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.757454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:55.772348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:55.773341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:01:55.774417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:55.777437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 337/689] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:01:55.784267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:55.906475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 353/690] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:01:55.920623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bff41-3032-41a3-a96d-0fe437c5e298 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:55.967573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:55.968597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:55.969084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:55.969574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:55.970615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:55.971144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:55.972119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:55.973039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:55.995705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 338/691] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:01:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:56.002814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.005831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.091477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.170753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2979-ddaa-4562-880a-036edc675593 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.214484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44692392-1cb4-4233-816f-97aae4fcd275 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.260276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.260987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.261204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.261490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.261774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.262665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.263150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.263622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.276281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:56.283210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:56.284174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:01:56.285011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:56.287820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 354/692] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:56.296775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.359613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:56.361115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b390e5-8238-4963-ace7-c1a3915ccd83 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:56.363225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.447711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838a0f-8926-435b-8965-e0f83bfa3741 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.456264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.473261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 339/693] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:56.474855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fddb2-b926-4972-9051-940d83218148 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.475130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fddb2-b926-4972-9051-940d83218148 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.475410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fddb2-b926-4972-9051-940d83218148 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.476893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 340/694] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:56.482641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fddb2-b926-4972-9051-940d83218148 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.489324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.490327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.490835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.491325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.492277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:56.492883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:56.494875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6774b-fc24-48e9-a1d1-faa7f7b162a1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:56.504349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 355/695] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:56.506101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.506600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.507105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.527058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:56.528620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:56.603345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fddb2-b926-4972-9051-940d83218148 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.604363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 356/696] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:56.605428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.610796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.666663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.667450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.667741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.668025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.679847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:56.682262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:56.699627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:56.700550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:56.701451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:56.701451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:56.701451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:56.701451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:56.701451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 341/697] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:56.702173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.718903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.723349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd89e81-0314-4d18-8f46-e19bd9ab2ccf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.771181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.771861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.772327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.772939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.792835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:56.794617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:56.811739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:56.812746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:56.813626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:56.813626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:56.813626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:56.813626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:56.815965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 357/698] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:56.817063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.835554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337f022-ffed-413a-aadd-0e8df35106cc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.881649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.882458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.882820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.883258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.898432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:01:56.905105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:56.906114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:01:56.907009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:56.912500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 342/699] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:56.913520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:56.932574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:56.942521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b3b3-eec1-42b8-8fb1-a78191b0e5d0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:56.981384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:56.982342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:56.982801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:56.983254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:56.984202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:56.984746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:56.986357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e60c6-209d-4b31-a93b-3ccfa4b2fa98 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.042127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28cc7-723c-46c0-8d2d-310cc450eff9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.084684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.085334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.085617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.085926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.086817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:57.087277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.089589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.110013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 343/700] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:57.110013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.120913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 358/701] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:57.122084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b999e2-5592-49b5-b6e9-51a9089131c5 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.122375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b999e2-5592-49b5-b6e9-51a9089131c5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.122656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b999e2-5592-49b5-b6e9-51a9089131c5 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.127723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 359/702] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:57.127723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b999e2-5592-49b5-b6e9-51a9089131c5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.143349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.220176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.252554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3191-bd93-4adf-9b5e-e8fa757e7cc6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.280853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b999e2-5592-49b5-b6e9-51a9089131c5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.298194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.299184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.299475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.299754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.300479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:57.300784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.302511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72bd3b-e27e-4a24-8d40-f8e1699a6435 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.316105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 344/703] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:57.316105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.316105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.316105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.333981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:57.334972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:57.340435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.343661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.343661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.343661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.350685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.354121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:57.368700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:57.376319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 360/704] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:57.377464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.424752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 345/705] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:57.425893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.460379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.495604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964b29-e32d-4981-a27a-0a235bd8db7d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.512029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.537498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.538489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.539070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.539529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.548450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.549934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.554581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e93d8-115c-4511-8f90-604df2ebc63a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:57.562522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:57.563662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:57.564617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 361/706] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:57.565128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.599634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.600367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.600658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.600941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.613969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.617899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:57.636440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:57.638143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 346/707] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:57.639619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.687436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98479bcc-0235-4676-914e-f6b91c6f516e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.726313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.733288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.734234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.734741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.735260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.736250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:57.736904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.738620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.759483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 362/708] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:57.761017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.770439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4154a4-f5a7-4cc7-9410-807e68a0a72e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.794471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:57.815436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.816512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.816795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.817076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.818121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.819499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:57.832004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:57.833177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:57.834224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 347/709] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:57.835091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.894181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395cc74-788f-43ad-9650-b6c2f0e04373 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.935821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.936451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.936744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.937013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.937800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:57.938114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:57.939543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:57.953191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 363/710] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:57.954136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:57.960333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120aecb-59d6-47b8-a60e-a6b5e422aa31 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:57.997001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:57.997643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:57.997951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:57.998231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:57.998946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:57.999244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.000636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.004501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.016389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 348/711] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:58.016389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.067006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.069017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bcc43-b221-4ed3-9f4c-ff79a7d5fbc9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.106656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.107278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.107558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.107852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.128561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e346b7-ec4d-42da-bf80-d3742f9be766 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.163898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.164533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.164868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.165218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.165949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] RBAC: Adding query filter params (name=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:58.166260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.167661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe08ef-263a-44d4-ac72-0e9d8ca54a0e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 349/712] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15169-522a-4836-be15-4f4a6f77d113 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15169-522a-4836-be15-4f4a6f77d113 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b15169-522a-4836-be15-4f4a6f77d113 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 350/713] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:01:58.177115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15169-522a-4836-be15-4f4a6f77d113 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.190546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.192041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.240836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.287529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b15169-522a-4836-be15-4f4a6f77d113 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.295323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.295820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 364/714] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:58.297030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.327241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.327862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.328142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.328415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.329204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=2e5baeab919f40e2b92f155a0c34d8d8) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:58.329511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.330988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.339258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 351/715] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/role_assignments?user.id=2e5baeab919f40e2b92f155a0c34d8d8&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:58.340096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.422872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2f45f-8511-4b48-8ee9-9ca14058a895 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.467328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fefa8-1125-4c70-98d0-15be3e85f583 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.469406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.471066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.471352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.471634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.480964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.482749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0b2178e8-3093-4cbb-b269-818daacb8d4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:01:58.496211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:58.497259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:58.498278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 365/716] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:58.498883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.498883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.500129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.518542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.519196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.519485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.519785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.520573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] RBAC: Adding query filter params (type=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:58.520777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.522192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.523342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:01:58.524938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:01:58.529730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 352/717] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:58.529730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.530502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.580466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.637924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 366/718] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:01:58.638826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.684211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d1de-261e-468d-9245-b760da54cb4e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.734555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.735226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.735586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.736102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.749923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.751738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:58.777411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:58.778443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:58.779330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:58.779330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:58.779330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:58.779330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:58.779330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 353/719] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:58.780190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.784352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99ad83-06a6-4844-808f-9f9195bbef18 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.826959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.828489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.828781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.829066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.829923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:58.830239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.831750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.844004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.860352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 367/720] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:58.861463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:58.891913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.910595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0cb65-842f-4120-82a9-6a23d91980f0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:58.962496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:58.964224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:58.964725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:58.965700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:58.966626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:58.968930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:58.982571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:58.983584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:01:58.984427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:01:58.992220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 354/721] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:58.992220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.003671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f194e2-9a7c-437f-9e36-45e68ebed3b6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.047917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.048580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.048917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.049204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.049976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:59.050288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.051664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.065408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 368/722] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:59.066130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.126648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502343b4-5d87-4b23-8a10-3882c4d177cc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.141136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.176245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.178325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.178838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.179322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.194840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556d0d-a673-4457-bf95-a5f60ff1440a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.202797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.245895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.246567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.246850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.247123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.247879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:59.248334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.249873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.260383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 369/723] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:59.260383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.270377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.272342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.370984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612511e6-d778-4c00-a9cc-596dc83ba87e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.385852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 355/724] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:59.387453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.394471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.409799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.411726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.411726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.411726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.419472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.422017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:01:59.435565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:59.436547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:01:59.437434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:59.439859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 370/725] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:59.440984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.557655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f66b7-ba4f-4582-b779-ec9defa6ea5a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.569473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.594682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.595677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.596138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.596690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.609307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.611146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.626104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e47-2be1-45d2-b70f-7183c9f3610f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:01:59.628683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:01:59.629537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:01:59.630504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:01:59.630504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:01:59.630504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:01:59.630504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:01:59.632851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 371/726] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:01:59.635185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.665860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.666549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.666906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.667399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.668173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:59.668782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.670170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.672422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.681894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 356/727] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:59.683180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.762568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5120e3-180b-42c6-82f8-61cae80364fe None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.872134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd31952-2c9c-41df-b8e8-287449e6517b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:01:59.893770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:59.895362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.895362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.895832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.896210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.897086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:59.897517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.899149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.917521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 372/728] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:59.923306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:01:59.923578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:01:59.924437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:01:59.924891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:01:59.925316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:01:59.926201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:01:59.926852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:01:59.929394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:01:59.946304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 357/729] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:01:59.955035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:00.057407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:00.075707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732924ce-8a8a-444e-a974-d2940f7b32d3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:00.131238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:00.131880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.132166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.132449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.134880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:00.135191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:00.136661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:00.152354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 373/730] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:00.155801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cad40-27bb-4bfc-a9fe-b2b553a48ccb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:00.227932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:00.228957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.229482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.229990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.239070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:00.241003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:00.256524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:00.257510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:00.258535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:00.261490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 358/731] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:00.267148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:00.459601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46a9dd-783b-4af8-8c1c-3c4a22722bf6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:00.514623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:00.515192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.515478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.515758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.516533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:00.516842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:00.518378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29163-548e-4c4c-919e-51f1fc318c6c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:00.533012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 374/732] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:00.539166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:00.614913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:00.705911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcbc85-223d-482c-9c69-93fb87104d7a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:00.748983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:00.749625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.749938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.750218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.751022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=d6805ff422004601b0e93eb98138eaa7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:00.751334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:00.752875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da7ff-c34f-46f2-ad30-78d1664ef2da None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:00.761620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 359/733] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:00 2022] GET /identity/v3/role_assignments?user.id=d6805ff422004601b0e93eb98138eaa7&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:00.876515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a319-2f0f-4d5d-9dd5-f2f47f2ea8d8 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.876859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a319-2f0f-4d5d-9dd5-f2f47f2ea8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.877083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a319-2f0f-4d5d-9dd5-f2f47f2ea8d8 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.878875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 375/734] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:00.884886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ba16-54df-4cdf-91b3-c4c83a90d14c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:00.885229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ba16-54df-4cdf-91b3-c4c83a90d14c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:00.885462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ba16-54df-4cdf-91b3-c4c83a90d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:00.918444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6c79ba16-54df-4cdf-91b3-c4c83a90d14c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:00.919695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6c79ba16-54df-4cdf-91b3-c4c83a90d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:01.004313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 360/735] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:02:01.043503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487a319-2f0f-4d5d-9dd5-f2f47f2ea8d8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:01.067984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:01.075142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d642-e95f-4bf9-8fab-eab8d15f1693 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.075733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d642-e95f-4bf9-8fab-eab8d15f1693 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.076173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7d642-e95f-4bf9-8fab-eab8d15f1693 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.081891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 361/736] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:01.083355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.083853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.084337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.118974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:01.120632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:01.172620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:01.192174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487a319-2f0f-4d5d-9dd5-f2f47f2ea8d8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:01.253810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 362/737] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:02:01.257557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:01.258269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.259087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.259366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.270238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:01.275625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:01.277386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:01.280600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 376/738] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:01.285572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:01.312931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:01.447784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466885f-4ea5-479c-b292-b85b60209e04 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:01.492996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:01.493623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.493950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.494282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.495018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:01.495325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:01.496708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:01.502289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:01.511644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 363/739] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:01.519674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:01.543312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:01.560122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9568f8-37ee-41b1-bd67-34974e48b037 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:01.629521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27b22-0359-45f3-8125-04da92cff714 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:01.671404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:01.672070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.672356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.672624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.677776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:01.678425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:01.678709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:01.678984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:01.681468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:01.683080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:01.700753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:01.702306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:01.718609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:01.720290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:01.722627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:01.722627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:01.722627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:01.722627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:01.722627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 364/740] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:01.729171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:01.882381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 377/741] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:01 2022] POST /identity/v3/services => generated 240 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:01.892344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:01.970571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d5ff9-1d6a-4d07-bc26-9141bb3703f7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:02.066868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:02.067846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.068315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.068830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.069999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:02.070522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:02.073134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec89ef-ca06-4cb5-8e7b-08b2476a9fda None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:02.108617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 365/742] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:02.117112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:02.152855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6bd1-44a4-4d92-8415-9a796bc7b258 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.153092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6bd1-44a4-4d92-8415-9a796bc7b258 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.153396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6bd1-44a4-4d92-8415-9a796bc7b258 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.155001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 366/743] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:02.161666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.162171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.162308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.193483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:02.194752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:02.310799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cae5e-8014-4dfa-b85b-8e34da45f5c4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:02.311759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 367/744] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:02 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:02:02.340442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:02.354101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:02.355095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.355602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.356086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.359306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:02.365322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:02.367147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:02.380281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:02.386434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:02.387409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 378/745] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:02.389593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:02.404029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:02.448296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7d7a6-13f7-42b1-8cd0-777bd6e40f80 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:02.508966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ef2d-d570-4071-919d-5bf5a167f4ef None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:02.527228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:02.527851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.528130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.528395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.529092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:02.530481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523f27-f6e4-4c69-8b45-c60498ef779e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:02.568896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:02.569951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.570448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.570997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.572161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:02.572707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:02.574463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:02.596552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 379/746] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:02:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:02.603274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:02.634315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 368/747] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:02 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:02.673086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:02.723469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120f53-d773-48f9-915b-c802691b49bf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:02.743477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d513-222b-4509-a938-a636361d0ae4 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.744035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d513-222b-4509-a938-a636361d0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.744480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7d513-222b-4509-a938-a636361d0ae4 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.746954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 369/748] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:02.754288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.754787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.755425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.783166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:02.784522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:02.816609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:02.817956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:02.818254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:02.818535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:02.913836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 370/749] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:02.928372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:02.929853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:02.935258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:02.995208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:02.999007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.058625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 380/750] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:03.063026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d0d12-3ed9-4a69-b84e-9c33ac6e0d5e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.066755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.143391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.144062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.144347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.144624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.170181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:03.179801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:03.181087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:03.181980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 371/751] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:03.187974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.235634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b31d-1694-4530-b2b4-9bf2ce72bfee None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.285855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.286529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.286820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.287101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.313821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.315295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:03.340438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:03.342602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:03.344749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:03.344749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:03.344749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:03.344749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:03.349789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 381/752] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:03.349789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.350219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e876-ef0a-4bf3-81d1-1b0a88949942 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.351314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.359862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.388746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.389811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.390296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.390768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.392715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:03.393302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.395160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.406888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 372/753] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:03.412769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.506658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb327598-9355-49f9-920f-2b0234e49c70 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.527941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c2e4-3dcd-4849-bb99-c3e14fd56766 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.551087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.551773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.552006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.552284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.552988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:03.553292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.554734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.572233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 382/754] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:03.575422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.576392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.576896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.577373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.578802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.590520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.592458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:03.610457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:03.611420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:03.612365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:03.612365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:03.612365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:03.612365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:03.614657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 373/755] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:03.620840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.650054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.725220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.742213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd630552-7233-4d16-b9a2-3280b3bc7ce2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.785871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.785871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.786421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.786893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.787710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:03.788124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.789888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.799274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292c31-2440-4408-95d5-967a0e20f899 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.806371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 374/756] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:03.812991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.887728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.888638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.889105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.889531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.906961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.908695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:03.910497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:03.931866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fd203-9dc4-4012-a0b3-ff0147d52cb5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:03.938084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:03.939077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:03.939987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 383/757] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:03.955526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:03.978829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:03.979862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:03.980442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:03.980939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:03.989058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:03.990890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-88cee796-dd0e-4052-8737-056c5e3be033 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:04.004593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:04.005565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:04.006566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:04.014100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 375/758] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:04.015749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939ddb-c634-4005-a774-77bdb5aa9e8d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.016262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939ddb-c634-4005-a774-77bdb5aa9e8d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.016782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939ddb-c634-4005-a774-77bdb5aa9e8d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.018500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 376/759] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:04.020177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc939ddb-c634-4005-a774-77bdb5aa9e8d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.085990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e87ae8-ddd3-44d7-aceb-491c01433d2f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.120394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.135315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.135315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.135315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.135685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.136368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:04.136660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.138206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804900-41c7-4815-a896-5d5d167e737d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.152288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 384/760] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:04.155097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.155387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.155663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.174459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:04.175738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:04.182948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc939ddb-c634-4005-a774-77bdb5aa9e8d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.221710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.223577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.224064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.224535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.225553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:04.226086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.229541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.248772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.260176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 377/761] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:04.260176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.274915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 385/762] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:04.276130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.394602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71b4a-efda-45b1-9cc1-a32e181c0da8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.403163 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b29de-04bf-4f08-9af2-4c559b19d826 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.421721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.433835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.434683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.435115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.435540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.436473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=2e5baeab919f40e2b92f155a0c34d8d8) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:04.436977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.438580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.445407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 378/763] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/role_assignments?user.id=2e5baeab919f40e2b92f155a0c34d8d8&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:04.446973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.462818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.463842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.464275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.464698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.486931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.490275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:04.519711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:04.520848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:04.522009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:04.522009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:04.522009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:04.522009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:04.526997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 386/764] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:04.535218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.574251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.632809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7b90e-66f3-4ab4-877c-0fba6bc96d82 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.682089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb335d5-3e2c-4257-8081-b345852665b6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.701147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.701842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.702098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.702372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.723251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:04.724757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.726087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.726591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.727657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.728660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:04.729224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-38b7ff72-868d-44ff-ab85-8c2ba1867311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:04.730271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:04.731250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:04.732173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 379/765] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:04.733455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b686d6-99c3-4fe1-af8f-22b7b2f41212 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.733455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b686d6-99c3-4fe1-af8f-22b7b2f41212 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.733614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b686d6-99c3-4fe1-af8f-22b7b2f41212 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.734561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823f5b-8183-48be-a243-215b6241325f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.739245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 380/766] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:04.741198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b686d6-99c3-4fe1-af8f-22b7b2f41212 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.752078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 387/767] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:04.753958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.754598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.755098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.787975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:04.789122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:04.811719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.873953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 388/768] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:04.874908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.887521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b686d6-99c3-4fe1-af8f-22b7b2f41212 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:04.919513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:04.931248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:04.932067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:04.932449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:04.932839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:04.933672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:04.934106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:04.935603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:04.945397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 381/769] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:04.946903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:04.994820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2377b2-f90a-4a5a-9c30-20f330d126be None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.053643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.054910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.055906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.056365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.067006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.069584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.074652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90ba-a1c4-44d8-a70e-65814da095b4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:05.090701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:05.091826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:05.092921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:05.094713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 389/770] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:05.095722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.113188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.130039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.130752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.131025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.131352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] PATH_INFO: `/v3/services/network` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.131988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.134055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:05.146223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:05.147308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:05.148163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:05.151637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 382/771] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:04 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:05.152695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.207277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c348-6162-409f-b752-0ed7aeb0575e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.219982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.246034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.246696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.246986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.247983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.259019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.260767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-c30b7ff8-fd1b-4afe-8bf5-7ef1ebec995f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:05.277743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:05.278714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:05.279579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:05.279579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:05.279579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:05.279579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:05.279579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 390/772] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:05.280424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f79a6-e9c0-417e-adb9-48bb541d8fbf None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.280424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f79a6-e9c0-417e-adb9-48bb541d8fbf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.280702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f79a6-e9c0-417e-adb9-48bb541d8fbf None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.286331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 391/773] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:05.286331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f79a6-e9c0-417e-adb9-48bb541d8fbf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.289085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f5e7-6808-4b8f-aef6-e48ba9603e09 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.326976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.327840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.328263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.328669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.329429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:05.329736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.331197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.346821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 383/774] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:05.347637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.369399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.407439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f79a6-e9c0-417e-adb9-48bb541d8fbf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.447021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.447985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.448268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.448545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.449244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] RBAC: Adding query filter params (name=network) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:05.449550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.450972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe0f13-11ab-4a5f-9157-99b8fedb654a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.455970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 392/775] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:05.458741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c5e9-7998-48f3-9120-80d764e4e74b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.461898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.462193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.462474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.473023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.481388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:05.482636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:05.501964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.502600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.502877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.503157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.503852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:05.504160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.505527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.522965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 384/776] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:05.523748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.562741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 393/777] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:05.563885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.637287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.650516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b92c-6a65-4508-aadd-0778071230ea None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.687786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf21f36-5143-4191-ad1d-e1a2b9665d70 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.694352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.695038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.697312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.697312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.698496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=4b73ce0aeb0846d88bf3e4b21405eda3, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.699986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.726933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.728186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.728438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.728667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.729310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] RBAC: Adding query filter params (type=network) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:05.729597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.731011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.737336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 394/778] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:05.738190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.829799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 385/779] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:05 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:02:05.829799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.870271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a036e-53df-4985-9e88-5a4785c49797 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:05.870877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.903659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:05.916884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:05.917858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:05.918214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:05.918593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:05.929941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:05.933650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:05.951387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:05.952544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:05.953710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:05.957948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 395/780] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:05.958948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:05.985230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a731502-5532-4dac-8221-5977452ddbec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.045063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.046012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.046472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.046995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.047639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.049018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:06.060606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:06.061629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:06.062552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 386/781] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:06.063402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.111570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2373b-9e54-4e5d-abc3-3ef994a5edb7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.158372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.162322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.162678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.163021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.163899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] RBAC: Adding query filter params (interface=public, service_id=3d31f1da04e64304839ad445e377b667, region_id=RegionOne) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.164276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.168437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.175174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 396/782] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:05 2022] GET /identity/v3/endpoints?service_id=3d31f1da04e64304839ad445e377b667&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.180817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.193774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.202137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da3ce-7a2f-41cc-a74f-e2c82e6e73bc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.235916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.248655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.249580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.250149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.250598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.251622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.252087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.253775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.277308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 387/783] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.279046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.302202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507b03b-ee97-4673-8906-b06b47c23aed None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.338904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.339639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.339988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.340351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.341131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.341498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.342991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.348414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 397/784] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.349401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.417491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290710b-9147-4566-9c74-ecf08439f462 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.457668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.458684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.459197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.459681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.460512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.462374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.468571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 388/785] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.469665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.478823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d502d4d-7e52-4243-a784-ec6339fc034d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.491463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.502905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.530711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.531137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.531369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.531651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.545956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.548111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:06.565505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:06.566514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:06.567420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:06.567420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:06.567420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:06.567420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:06.567420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 398/786] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:06.572504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.617129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2912-db0c-4780-80b0-f8f07edf0190 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.668332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.669552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.670057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.670583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.671458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.672009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.673697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793120-1473-480e-8e5c-227f5662ed5e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.680835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 389/787] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.682748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421b42-b956-423d-9cda-ec831844930c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.683307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421b42-b956-423d-9cda-ec831844930c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.683776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da421b42-b956-423d-9cda-ec831844930c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.686129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 390/788] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:06.687433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421b42-b956-423d-9cda-ec831844930c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.719903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837531f-148c-484c-8b5d-31ed9cde7536 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.782738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.783843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.784396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.784872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.785797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.786307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.788016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734b56a-ad74-4c57-9591-fdc12c2f1aa6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.808314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 399/789] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.810279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.810778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.811275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.817194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.837900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:06.839446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:06.845315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da421b42-b956-423d-9cda-ec831844930c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:06.868556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:06.889331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:06.890439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:06.890928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:06.891402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:06.892373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] RBAC: Adding query filter params (interface=public, service_id=a10d8055a0794273aac23b1306b857d0, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:06.892888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:06.895023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:06.904740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 391/790] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/endpoints?service_id=a10d8055a0794273aac23b1306b857d0&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:06.905953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:06.931605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 400/791] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:06.932524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.015506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34e35-0cb5-45c7-9e43-8d340a00f4a9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.049791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e1cf0-d247-4f6a-8be2-1cbbb572c45e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.054203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.054961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.055379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.055804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.063393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.065095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:07.078641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:07.079589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:07.080479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 392/792] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:07.081798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.085539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:07.094758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.095405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.095695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.096034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.099150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.099150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.105441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 401/793] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:06 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:07.106452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.136641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:07.235906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690d05e-e5ac-4836-8d61-afec0b6bfa29 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.240126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a8794-987b-4d61-9d13-b7e8a7015a9d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.279183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.279821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.280152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.280439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.281208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:07.281526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.283076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.296180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.296980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.297277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.297544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.300512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 402/794] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:07.306898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.326293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:07.331947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:07.333005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:07.334795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 393/795] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:07.344157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.442524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:07.445165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:07.476955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb43525-cfb4-4473-a876-ac2959584312 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.515742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611d64-16b3-432a-9f0e-0f9be73512b7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.537424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.538545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.539105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.539726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/d6805ff422004601b0e93eb98138eaa7/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.558425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=d6805ff422004601b0e93eb98138eaa7, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.561412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.575255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.576320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.576814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.577299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.578356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:07.579069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.585339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.594106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 394/796] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:07.599480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.682413 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 403/797] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:07 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/d6805ff422004601b0e93eb98138eaa7/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:02:07.734887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0257-e24f-4a03-b156-31b1901f81c6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:07.766649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:07.784430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:07.785120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:07.785412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:07.785691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:07.804318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:07.806426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:07.829396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:07.830551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:07.831691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:07.831691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:07.831691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:07.831691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:07.837790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 395/798] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:07.839137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:07.986912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6ca3-92f0-47bc-ac19-a2dc568e0e53 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.022075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:08.030909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:08.031686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.032072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.032469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.033271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:08.033683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:08.035176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:08.051595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 404/799] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:08.057954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.197105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec30751-49c5-45b2-a718-d7ad99304717 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.241398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bbe64-793f-489a-9439-127528266738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:08.242109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbe64-793f-489a-9439-127528266738 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.242397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbe64-793f-489a-9439-127528266738 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.242813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bbe64-793f-489a-9439-127528266738 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.251474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bbe64-793f-489a-9439-127528266738 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:08.252935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bbe64-793f-489a-9439-127528266738 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c64bbe64-793f-489a-9439-127528266738 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:08.269225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:08.270284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:08.271235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:08.276783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 396/800] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:08.278862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.393364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921793d2-a9ec-48b0-b318-5a4f352af267 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.393728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921793d2-a9ec-48b0-b318-5a4f352af267 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.393990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921793d2-a9ec-48b0-b318-5a4f352af267 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.395638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 397/801] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:08.401991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.402564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.402850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.425520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:08.427543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:08.435212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec002c-d63f-44b4-829f-5d766a176103 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.486492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:08.510899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:08.511538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.511822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.512101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.512913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:08.513223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:08.514696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:08.550237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 405/802] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:08.560369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.568262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 398/803] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:08.595962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.662551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:08.726669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ac44-2c6f-4285-86f1-ec370a58af39 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.772848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:08.774877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.775168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.775452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.794866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa5b7-8e56-4f43-a205-716f3c3d3473 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.800425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:08.811352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:08.812353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:08.813185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 399/804] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:08.818727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.871950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:08.902776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:08.904351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:08.904856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:08.905334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:08.932293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:08.937778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:08.937926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745ed9b-9081-4063-bcaf-9d0b37a7a99e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:08.963568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:08.964532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:08.965428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:08.965428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:08.965428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:08.965428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:08.965645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 406/805] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:08.975296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:08.999040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.000149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.000727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.001209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.002324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:09.003120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.005432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.026312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 400/806] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:09.034822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.143011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.147302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f5c75-bbf1-45c9-88ac-89ff27771c49 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.186182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.187407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.187953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.188458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.189377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:09.189934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.191107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.192119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63878e3-cd59-4a54-9c70-8c07c2692d87 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.202522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e94db-074c-4108-bfb4-6ac7c461759d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.205956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 407/807] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:09.209428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cea5-1591-4b81-9a7c-e873fc359665 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.209428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cea5-1591-4b81-9a7c-e873fc359665 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.209428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458cea5-1591-4b81-9a7c-e873fc359665 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.210038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 408/808] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:09.219271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458cea5-1591-4b81-9a7c-e873fc359665 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.247294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.247964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.248275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.248666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.262050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a79fe39c-0ed6-4e8c-87c3-5bf686a0eb0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:09.279902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:09.280870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:09.281795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:09.281795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:09.281795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:09.281795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:09.281795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 401/809] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:09.282874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.283166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.283449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.303477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:09.304899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:09.358174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458cea5-1591-4b81-9a7c-e873fc359665 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.401326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 402/810] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:09.401326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.426545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.427223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.427511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.427796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.438968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.441035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:09.457073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:09.458117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:09.459017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:09.461837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 409/811] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:09.463042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.489805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.497919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.536813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caaf97-390f-4fe1-9c27-fe09e5273e23 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.584585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.585656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.586310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.587455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.588971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:09.589720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.591603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.602883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f310-687b-471b-8d4b-d1ef689b1789 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.607347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 403/812] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:09.608686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.647051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.647707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.647989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.648263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.648947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.650372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:09.661895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:09.663094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:09.663946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 410/813] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:09.665414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.732350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66322-db71-416e-977f-05ba78eb92b7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.764151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.769237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:09.775885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.775885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.775885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.776263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.776897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:09.777209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.778717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520cad4-a0b6-4265-a6ed-707a916d2d73 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.792502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1957743-58a9-45a8-a25d-aa00856d0c3b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.794791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 404/814] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:09.796289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d3e4-d1d5-4141-9740-5ea4db6c8b4d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.796577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d3e4-d1d5-4141-9740-5ea4db6c8b4d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.796847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d3e4-d1d5-4141-9740-5ea4db6c8b4d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.798269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 405/815] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:09.802767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d3e4-d1d5-4141-9740-5ea4db6c8b4d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.844448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.845433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.845946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.846422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.860427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.862957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:09.878483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:09.879684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 411/816] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:09.880726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:09.936109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d3e4-d1d5-4141-9740-5ea4db6c8b4d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:09.974597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:09.975479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.975938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.976357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:09.977808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:09.978263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:09.979810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7cb8-ef59-4418-9684-25741c88e0f3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:09.984660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 406/817] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:09.985996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09470-2007-4cd8-815d-45697511be29 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:09.986284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09470-2007-4cd8-815d-45697511be29 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:09.986559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09470-2007-4cd8-815d-45697511be29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.002485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c155-bcbb-49d3-84fb-ea6acca6f71b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.006009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-70d09470-2007-4cd8-815d-45697511be29 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:10.007208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-70d09470-2007-4cd8-815d-45697511be29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:10.039501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.041036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.041249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.041528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/2e5baeab919f40e2b92f155a0c34d8d8/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.043784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=2e5baeab919f40e2b92f155a0c34d8d8, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.045239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.064536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.080461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 407/818] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:10.081380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d09470-2007-4cd8-815d-45697511be29 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.146102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 412/819] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:09 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/2e5baeab919f40e2b92f155a0c34d8d8/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:02:10.146936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.154144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.198674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d09470-2007-4cd8-815d-45697511be29 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.240290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.240941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.241227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.241506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.242368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:10.243065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.244279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c6a77-8713-4d61-ae39-e1397d025888 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 408/820] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9202-1463-4d78-adaa-b4e5ae247abb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9202-1463-4d78-adaa-b4e5ae247abb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d9202-1463-4d78-adaa-b4e5ae247abb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 409/821] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:10.271802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d9202-1463-4d78-adaa-b4e5ae247abb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.287839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36131997-2ec3-4643-be3e-c93ee7293ed2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.331410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.331856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.332784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.332784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.333163 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.333780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] RBAC: Adding query filter params (type=network) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:10.334378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.335836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.345949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 413/822] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:10.345949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.398443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d9202-1463-4d78-adaa-b4e5ae247abb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.442642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.442895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.443763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.444043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.444326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.444966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.447046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-74cfef9f-a15e-4959-8ee4-26bbd8188841 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:10.466946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:10.468193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:10.469230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 410/823] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:10.470227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.470227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.470227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.484406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:10.485530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:10.491282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f728e8-1f44-4ef2-9190-844f91671e97 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.531861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.532796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.533151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.533436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.571312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 411/824] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:10.572859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.616445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.618514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.634955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.694958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:10.704979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e24a-c927-4219-aa97-b21ce863bf72 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.733320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 414/825] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:10.734607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.753320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.757310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.757310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.757310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.757310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.757310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.849147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6979-422e-4229-adf8-7c885dafa0a2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:10.882383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 412/826] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:10.883368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.893635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:10.894525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:10.894798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:10.895073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:10.895792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:10.896104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:10.897545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:10.910532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 415/827] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:10.913998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:10.957712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.029735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba8de2-db49-4d1a-8111-4f1c8941ca5d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.038176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.073199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ddb5-95a8-43cf-a4c4-15e6314b6aea None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.076907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.077954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.078086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.082582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.094026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:11.098958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:11.099901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:11.100754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 413/828] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:11.101830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.129140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.129821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.130104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.130375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.146007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.147480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:11.169174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:11.170319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:11.171477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:11.171477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:11.171477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:11.171477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:11.173306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 416/829] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:11.174290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.231075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a25c63-9dca-4ab9-89a0-650a24798732 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.267810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.276554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.279595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.279595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.279595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.279595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:11.279595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.280279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.290950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 414/830] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:11.291949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.296668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e646-bd26-4451-bc14-d98c33922d5d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.313874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.337317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.338205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.338434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.338710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.339441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:11.339746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.341141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.354111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 417/831] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:11.354111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.417070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a237-2d20-4338-ba1d-06034a15f53a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.458338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.458975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.459266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.459551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.460249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:11.460561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.462174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.467750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2abd33-166b-4660-93cb-0eb18169d64d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.478969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 415/832] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:11.478969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.513581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.514231 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.514533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.514782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.515516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.516856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.530057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.569865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.591476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71454c-b302-47c3-bb98-115a0031e94c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.612779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 418/833] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:11.612779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.641680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.642494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.642784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.643060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.656547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.658211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:11.676855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:11.677893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:11.682546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:11.682546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:11.682546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:11.682546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:11.682546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 416/834] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:11.686507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.772616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9d2db-0cca-4336-9bf6-198ad6a8843d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.833244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.834253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.834788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.835256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.846600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.849032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.864321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679ec7-f49d-4e17-9ca5-e4c973794fce None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:11.870461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:11.871583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:11.872688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:11.873222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 419/835] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:11.883552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.921067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:11.927364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:11.928704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:11.929439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:11.930890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:11.932490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:11.938496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:11.938496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:11.967392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 417/836] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:11.969226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:11.983319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.060688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f88e-5a8c-4fe0-af6c-92d2a75ee4ac None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.120567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.121584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.122069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.122604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.124115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:12.124640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.127185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.150364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 420/837] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:12.155795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.171280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41726ae-577c-4f18-98dd-e18e45a2d203 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.217189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.218008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.218397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.218772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.226817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.228649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c23eb985-ca03-42e8-a410-9315063bdbe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:12.241627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:12.243973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:12.245050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:12.249216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 418/838] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:02:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:12.249861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-94f7-482c-999e-5618f58fb181 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.250155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-94f7-482c-999e-5618f58fb181 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.250430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde69e-94f7-482c-999e-5618f58fb181 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.252148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 419/839] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:12.252903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde69e-94f7-482c-999e-5618f58fb181 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.292653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6053d19-4b5f-4665-8c7a-9643b0e68d49 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.304857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.313079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.332084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.332712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.332994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.333271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.334112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:12.334444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.335872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaaba6-bc03-4025-a6a1-82ff4c62a53b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.349825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 421/840] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:12.349825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.349825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.349825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.370123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:12.374409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:12.388048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde69e-94f7-482c-999e-5618f58fb181 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.437303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.438062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.438548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.439156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.440688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:12.441255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.443055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.471159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 420/841] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:12.472464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.474017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 422/842] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:12.502934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.625364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fedfd-f7c5-4f60-a3e5-ed68034fd0aa None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.627952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.650876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed37d0-ec9a-46bc-a10c-786863baa01b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.667737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.674383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.675034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.675320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.675600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.700334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.701170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.701628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.702226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.716693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:12.724422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:12.725424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:12.726370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 423/843] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:12.734837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.766978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.768663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.881558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36074fa0-0286-4e94-a98b-21acc16d2cce None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:12.897832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 421/844] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:12.909778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.911533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:12.932203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:12.933442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:12.933733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:12.934046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:12.935091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:12.935403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:12.937418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:12.950822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 424/845] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:12.955979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:12.998419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.033879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7280e2-8ae6-44e3-863e-51f5b5ae2297 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.080266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.081029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.081313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.081631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.088177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c2e5-f116-4ca3-a918-e34cf3a5e1f8 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.094374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.095839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:13.115396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:13.116379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:13.117285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:13.117285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:13.117285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:13.117285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:13.121823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 422/846] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:13.122770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.143353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.144895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.145716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.146247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.160558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.162362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:13.179329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:13.181042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:13.182369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:13.182369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:13.182369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:13.182369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:13.187017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 425/847] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:13.188161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.202820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.268976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4a8-0d19-4b8f-8afb-6620a922eb78 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.293421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.316791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.317078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562126-0306-46e3-9367-f34764593a28 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.317733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.318166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.318534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.319343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:13.319754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.322504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.341852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 423/848] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:13.344105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.371301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.372296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.372803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.373281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.374234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:13.374815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.376393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.398560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 426/849] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:13.399954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.480445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ba77-0ab3-41f6-b56c-20ca4df2b2ff None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.501935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.521260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9859f-a350-4378-b5ba-8ea2c9c04990 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.526544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.527447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.527886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.528421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.536630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.539057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:13.555982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:13.559693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:13.560634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:13.561906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 424/850] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:13.565914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.578358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.579023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.579309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.579587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.588068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.589453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:13.603268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:13.604290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:02:13.605374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:13.609694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 427/851] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:13.610693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.625181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.703044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85675-1057-44a4-8b30-bf6626590fbe None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.738746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341414-f359-49d9-8395-238b69fa4248 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.753094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.754276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.755165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.755780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.756843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:13.757507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.759931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.783119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 425/852] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:13.788865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.798314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.798949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.799229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.799500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.800309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:13.800614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.802773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.837747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 428/853] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:13.839214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:13.841883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.919964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:13.921176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bd0a-6639-4cfb-80b0-7489d12b4e34 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.959144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d234-bbad-46c6-a1fa-ba7d85fb1af2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:13.960142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:13.960768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.961055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.962047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.963060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=d6805ff422004601b0e93eb98138eaa7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:13.963378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:13.964837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a68d71-ae68-4089-82b8-28de0a29d1ed None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:13.978963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 426/854] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/role_assignments?user.id=d6805ff422004601b0e93eb98138eaa7&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:13.978963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8863a-983e-44ae-bd07-53e8d31a6831 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.978963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8863a-983e-44ae-bd07-53e8d31a6831 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.978963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8863a-983e-44ae-bd07-53e8d31a6831 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:13.978963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 427/855] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:13.981549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:13.981871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:13.982162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.003913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:14.005252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:14.016207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.017107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.017659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.018131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.112460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.114379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.117926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 428/856] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:14.140359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.175665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.207964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.269438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 429/857] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:02:14.275659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.280878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfd0e5-331d-443f-85e6-30328f56c442 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.326781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.327449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.328301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.328592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.329241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.331138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:14.343522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:14.345439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:14.347176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 429/858] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:14.354411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.408996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cb473-5a92-464f-90e7-132e5f864c0a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.455158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.455941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.456125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.456449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.472112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.473722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:14.490003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:14.491012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:14.491988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:14.491988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:14.491988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:14.491988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:14.491988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 430/859] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:14.499479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.506814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.514669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424d64-4131-490d-b39e-683cd96a0898 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.524555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.554160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.554374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.554737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.555588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.556481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:14.556863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.558385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273c05-a14c-45ca-8fec-7b0bf0bcad64 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.564516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 430/860] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:14.566063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4fa0-7d03-4b75-a74c-05f5d28d668b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.566382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4fa0-7d03-4b75-a74c-05f5d28d668b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.566727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4fa0-7d03-4b75-a74c-05f5d28d668b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.568491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 431/861] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:14.570035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af4fa0-7d03-4b75-a74c-05f5d28d668b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.635637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed44c-8f9a-49e6-8206-327d5b1ecd91 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.679537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.680716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.681013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.681284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.682027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:14.682338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.683732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e03b5-0c14-4d58-adb2-677e1cffd0ca None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.696169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 431/862] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:14.697023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af4fa0-7d03-4b75-a74c-05f5d28d668b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.697520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.699918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.699918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.724490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:14.726085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:14.748185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.748817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.749103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.749383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.750084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:14.750389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.751757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.756613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 432/863] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:14.756613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.809602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.826605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 432/864] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:14.849806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:14.862459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:14.913461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079446e-3726-4b1a-b40d-dd2a2f2e0a9b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.955620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:14.956333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:14.956617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:14.956895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:14.965846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:14.967370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:14.976408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9bec7-b459-4c5e-80b2-e0c2441d7dc3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:14.981469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:14.983363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:14.985843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:14.990173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 433/865] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:14.993428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:15.028030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:15.029175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:15.029699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:15.030245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:15.031179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:15.032898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:15.044248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:15.045275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:15.046531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:15.049187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 433/866] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:15.057229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:15.114996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:15.140599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59fe1-5617-448b-9836-8ef546d03293 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:15.143099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:15.180728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:15.181426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80c76-2b8f-49a1-83c3-c0a7e7c26eee None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:15.182062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:15.182574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:15.183067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:15.184082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:15.184643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:15.186347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:15.201530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 434/867] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:15.210220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:15.229202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:15.230129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:15.230417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:15.230755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:15.231500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:15.231803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:15.233206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:15.244098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 434/868] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:15.247553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:15.362666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff75d-d12a-4cab-ab35-52b736fd988f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:15.393670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b3f2a-2bb7-4fb6-8ad9-1f45230dc88d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:15.405516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:15.406184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:15.406520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:15.406799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:15.407658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=2e5baeab919f40e2b92f155a0c34d8d8) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:15.408543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:15.410424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02d50-2ec1-4651-8bd8-251060f51b2b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:15.421938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 435/869] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:15 2022] GET /identity/v3/role_assignments?user.id=2e5baeab919f40e2b92f155a0c34d8d8&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:15.441954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:15.449094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:15.450148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:15.450653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:15.451185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:15.452108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:15.452633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:15.454264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043667d-e6eb-446e-b96f-8144c8c59101 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:15.460549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 435/870] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:16.308467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48eb21-0162-447d-9012-a31036baf172 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.309185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48eb21-0162-447d-9012-a31036baf172 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.309691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48eb21-0162-447d-9012-a31036baf172 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.311534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 436/871] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:16.317078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.318016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.318530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.337406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:16.338968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:16.410821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 436/872] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:16.434466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48eb21-0162-447d-9012-a31036baf172 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:16.444887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:16.549138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48eb21-0162-447d-9012-a31036baf172 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:16.585960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:16.587843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.588360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.588853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.601056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:16.607118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:16.608091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:16.608949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:16.611774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 437/873] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:16.617957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:16.735170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d084a2-3593-40a5-a33c-a22ac1ef8c47 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:16.770074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:16.773698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:16.774532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.774820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.775102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.775833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:16.776148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:16.777535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f044c-6fbc-4eef-b237-a48292e8750b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:16.787358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 437/874] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:16.792983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:16.869375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:16.907681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091364f-0de8-42c9-a7e1-9aa44ef8cd59 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:16.941448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c02b-70af-42ee-8119-a7877b187494 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.941742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c02b-70af-42ee-8119-a7877b187494 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.942061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33c02b-70af-42ee-8119-a7877b187494 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.943658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 438/875] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:16.945322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:16.946770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.947260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.947797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.949366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:16.949745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:16.950126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:16.960670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:16.962708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:16.968948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:16.970471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:16.979989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:16.980974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:16.981882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:16.981882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:16.981882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:16.981882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:16.987658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 438/876] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:16.989256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:17.057493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 439/877] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:17.080054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:17.111932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25e4a6-5c04-45eb-b8d4-8105c32383db None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:17.131864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:17.151350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:17.151986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.152274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.152555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.153258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:17.153672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:17.155359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:17.172506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 439/878] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:17.178242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:17.193990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b726f-0403-4bc1-9e0a-6c0fff49d201 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:17.218875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:17.246111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:17.246855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.247146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.247426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.248132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:17.249635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:17.311378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da404-52c4-4db6-960a-fd462a03548c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:17.324049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 440/879] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:17 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:17.383084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:17.384287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.385109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.385608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.395221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:17.397184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:17.411974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:17.413053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:17.414117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:17.417963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 440/880] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:02:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:17.429921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:17.554807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979417-54c8-41d4-91a0-b8825f439182 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:17.595629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:17.596634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.597198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.597686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.598865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:17.599392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:17.601060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1df2-f989-4e7b-bffc-340874d6bf44 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:17.624221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 441/881] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:02:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:17.629669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:17.674679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:17.694406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1253-9716-45d9-84ae-de6acee1014d None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.694744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1253-9716-45d9-84ae-de6acee1014d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.694964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d1253-9716-45d9-84ae-de6acee1014d None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.696604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 442/882] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:17.702250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a5c0-1ccc-4d0d-a265-7c8ee63f682d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.702457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a5c0-1ccc-4d0d-a265-7c8ee63f682d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.702684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5a5c0-1ccc-4d0d-a265-7c8ee63f682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.723814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-46f5a5c0-1ccc-4d0d-a265-7c8ee63f682d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:17.725087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-46f5a5c0-1ccc-4d0d-a265-7c8ee63f682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:17.760364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eed85-5450-49a3-b537-b930071e500f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:17.766778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:17.803330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:17.803960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.804310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.804546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.810531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 443/883] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:17.811882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4b83-5f04-4ada-a9f4-1012938c3721 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.812123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4b83-5f04-4ada-a9f4-1012938c3721 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.812399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4b83-5f04-4ada-a9f4-1012938c3721 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.813912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 444/884] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:17.819388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:17.819669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:17.819945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:17.843288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:17.844859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:17.890904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:17.892370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:17.929473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:17.941776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 445/885] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:17.941776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.010463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 441/886] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:17 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:18.010463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.063580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.069965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac282f39-93bc-4d21-b6bf-032c60d69ab3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.112606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.113260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.113545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.113861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.114502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.115911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:18.125558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:18.126812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:18.127799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:18.131851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 446/887] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:18.132753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.138490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8236-289e-4f10-9249-02fa7ed25134 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.190953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.191511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.191801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.192082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.192788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.194219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.198684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.248803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2109a-9ecc-4817-8eaf-eba3a485b11d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.293798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 442/888] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:18 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:18.293798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.300907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.301574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.301899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.302184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.315872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.317435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:18.339608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:18.341030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:18.342146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:18.342146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:18.342146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:18.342146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:18.342146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 447/889] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:18.347456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.362318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.463926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3b404-79a4-4422-a5e6-1830b5766e18 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.497368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c29b1-6c1b-4d7a-b307-06f72ba659c4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.506342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.506996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.507265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.507542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.510300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:18.510300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.510760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.516976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 443/890] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:18.524760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.545514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.546233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.546519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.546799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.547516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:18.547825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.549222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.566159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 448/891] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:18.574093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.614199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.669554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.675401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b2ee-7c28-4bee-9d28-2dddbedf3402 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.716918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f854-0d76-4516-94d1-3195f4b665f0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.719596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.720396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.720824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.721241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.722120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:18.722592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.724165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.741066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 444/892] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:18.755653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.756317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.756595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.756869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.770200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.770200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:18.785810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:18.787538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:18.789194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 449/893] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:18.794164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:18.921883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856cf49-37d9-478e-8402-26d3f11b45c0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:18.954181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:18.964947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:18.965590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:18.965903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:18.966184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:18.967002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:18.967258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:18.968704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68721983-dc85-4061-997c-e151837c4e8c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:18.983013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 445/894] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:18.988781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:19.107079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4c82-3c6c-46f7-8107-a0d3b6e8b725 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:19.137481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:19.146741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:19.147380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:19.147669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:19.147947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:19.148991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] RBAC: Adding query filter params (role.id=12445c1289fc42b48b544b615b65569a, scope.project.id=795fb0432e984025b689745107879b62, user.id=d6805ff422004601b0e93eb98138eaa7) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:19.149471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:19.150997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13c7f-4aab-41ce-a6fa-ac088cd9a58d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:19.157834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 450/895] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:18 2022] GET /identity/v3/role_assignments?user.id=d6805ff422004601b0e93eb98138eaa7&scope.project.id=795fb0432e984025b689745107879b62&role.id=12445c1289fc42b48b544b615b65569a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:19.492492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4617f6-e8cf-4afe-b56d-3a5aad3cf4ad None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:19.492931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4617f6-e8cf-4afe-b56d-3a5aad3cf4ad None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:19.493133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4617f6-e8cf-4afe-b56d-3a5aad3cf4ad None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:19.494833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 446/896] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:19.500391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:19.501301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:19.501831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:19.521785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:19.523367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:19.604949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 451/897] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:19.632363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4617f6-e8cf-4afe-b56d-3a5aad3cf4ad None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:19.745799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4617f6-e8cf-4afe-b56d-3a5aad3cf4ad None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:19.793352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:19.796868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:19.796868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:19.796868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:19.796868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:19.796868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:19.806758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:19.807832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:19.808663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 447/898] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:19.814073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:19.928006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22748d9c-affb-4979-9661-1c08e76e3e55 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:19.954154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:19.968617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:19.969745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:19.970344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:19.970852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:19.971843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:19.972159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:19.973584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:19.979977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 452/899] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:19.985461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:20.039116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:20.100163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed9c9-5f86-4800-ac81-323cc844ceea None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:20.145671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:20.146343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:20.146672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:20.146954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:20.147641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:20.147944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:20.149904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:20.157152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 448/900] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:20.162897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:20.279230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598426-6522-4846-a547-a4cb205118e9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:20.315321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:20.315874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:20.316163 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:20.316443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:20.317224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] RBAC: Adding query filter params (interface=public, service_id=0431e31b095a4150a4a5f229f77704e4, region_id=RegionOne) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:20.317538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:20.318955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294b697-73ee-44ad-afae-7dd2c2b5766a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:20.326002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 453/901] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:20 2022] GET /identity/v3/endpoints?service_id=0431e31b095a4150a4a5f229f77704e4&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:20.331654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:20.459891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c9f0-1041-4509-991b-4368558a048f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:20.472801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:20.500386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:20.501401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:20.502110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:20.502601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:20.503789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:20.505378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e37d-fb56-4c2d-9bd5-3abd8ca16c1d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:20.514128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 449/902] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:20 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:02:20.781118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198412-d9b5-4a6e-b7ec-0dbd2a13e9c4 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:20.781118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198412-d9b5-4a6e-b7ec-0dbd2a13e9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:20.781118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198412-d9b5-4a6e-b7ec-0dbd2a13e9c4 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:20.781859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 454/903] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:20.787600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92ac7-c668-4ae2-92a0-1c898fdb4bf5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:20.788274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92ac7-c668-4ae2-92a0-1c898fdb4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:20.788350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92ac7-c668-4ae2-92a0-1c898fdb4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:20.808590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-40b92ac7-c668-4ae2-92a0-1c898fdb4bf5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:20.809827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40b92ac7-c668-4ae2-92a0-1c898fdb4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:20.882516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 450/904] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:20.906998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198412-d9b5-4a6e-b7ec-0dbd2a13e9c4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:20.972917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.030523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198412-d9b5-4a6e-b7ec-0dbd2a13e9c4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.033146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dd1c-bae6-4f54-878c-5b3616a3277a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.033455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dd1c-bae6-4f54-878c-5b3616a3277a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.033716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dd1c-bae6-4f54-878c-5b3616a3277a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.035308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 451/905] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:21.041013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.041306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.041736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.061798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:21.063005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:21.073773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.074443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.074724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.075002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.075731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.077126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:21.089118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:21.090399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:21.091289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 455/906] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Aug 1 14:02:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:21.096469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.158056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 452/907] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:21.174021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.212897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.234283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c890d0-5449-4f9a-b586-e298dac81a1c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.249382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.272580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.273220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.273508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.274366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.275469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:21.275894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.277799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.288904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 456/908] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:21.290554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.295564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe30c5-c7fd-42fc-80d6-70014f3d2505 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.334684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.337773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.337773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.337773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.337773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.338689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7de6b2-d777-49b3-bfad-24d0b15e027f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.397890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd5e3-d928-44fe-97aa-0ebf0fa2844d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.407876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 453/909] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:21 2022] POST /identity/v3/services => generated 241 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:21.409598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690886-997a-4882-87a6-0e85dd7c5e47 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.415115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690886-997a-4882-87a6-0e85dd7c5e47 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.415115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84690886-997a-4882-87a6-0e85dd7c5e47 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.415115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 454/910] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:21.418262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.418619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.418963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.438082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:21.439445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:21.463048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.464046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.464519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.464981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.467781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:21.468061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.469502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.480315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 457/911] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:21.483875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.554474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 455/912] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:21.555730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.576106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.608979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.648625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9b06-3c57-47aa-9f07-e3f873d37ef6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.688026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.688753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.689099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.689451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.690318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] RBAC: Adding query filter params (interface=public, service_id=dee281fb3a5a49aca74db1d989273e58, region_id=RegionOne) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:21.690712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.692176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.698856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 458/913] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/endpoints?service_id=dee281fb3a5a49aca74db1d989273e58&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:21.706845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.718966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cdf5a-aead-48ee-853e-cfb88bd25a09 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.775444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.776105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.776389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.776714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.798622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:21.805594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:21.806745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:21.807596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 456/914] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:21.812588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:21.857568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bb40a-0a13-4266-9d53-92f0e10dfe4a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.860447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.899456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.900278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.900687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.901060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.901889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.903355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:21.917808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 459/915] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:02:21.936184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:21.944202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497898d-6c0a-47a2-8d20-43886b7a8d1d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:21.987523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:21.988699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:21.989578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:21.989887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:21.990636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:21.990942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:21.993038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.004008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 457/916] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:22.011517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.133015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73c4a9-4f3a-439d-854f-f39ec1f32aaf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.178048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:22.178708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.178990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.179245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.191762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:22.193213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:22.210395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:22.211396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:22.212300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:22.212300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:22.212300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:22.212300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:22.212963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 460/917] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:22.218564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.328546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa62a-6d46-4c49-88a2-08b7526f4264 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.364161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:22.364796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.365074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.365337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.366070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:22.366373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:22.367795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.380824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 458/918] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:22.387655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.417318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:22.512451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87165a2-d3e5-413a-a783-9ddfc8675e13 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.550513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:22.551418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.551856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.552283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.560354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:22.562152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0fe5368c-868f-4de1-93a4-8670f1e8fa86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:22.575525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:22.576743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:22.577920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:22.580076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 461/919] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:22.585813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.595369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:22.694132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63352c00-107c-41c3-a00b-f0330fe626e4 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.694347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63352c00-107c-41c3-a00b-f0330fe626e4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.694633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63352c00-107c-41c3-a00b-f0330fe626e4 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.695328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3eb7e-5cd6-402b-b0cf-dd14106e2ca7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.698833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 462/920] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:22.703767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.704058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.704336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.725885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:22.727805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:22.741255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:22.741914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.742870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.743321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.744031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:22.744340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:22.745796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.770930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 459/921] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:22.781810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.842658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 463/922] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:22.853551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:22.871658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:22.892970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:22.908511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30761e-973a-4d23-b1a5-5aee7f2a8406 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.954885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:22.955622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:22.956086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:22.956476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:22.967779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:22.969550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:22.983316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df92e29-a18d-4919-9a74-47f3b1cd8b5f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:22.989489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:22.990432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:22.991303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:22.991303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:22.991303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:22.991303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:22.994386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 460/923] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:23.001241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.025031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.026173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.026462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.026744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.027828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.029433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:23.041076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:23.042160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:23.042981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 464/924] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:23.048408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.138568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441caeb-ccdb-4bdf-adfc-f83a41811c07 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.142265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.160445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.179037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c60-89d3-4958-a575-fb3445d46689 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.181920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.183359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.183359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.183359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.184157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:23.184551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.186072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.200014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 461/925] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:23.205803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.220327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.221236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.221676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.222176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.223060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:23.223528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.225134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.231908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 465/926] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:23.238194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.335768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44718-671e-4ed8-894d-da783dff6571 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.370903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1a72-4493-4651-a528-9099822e1d17 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.374417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.374902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.375279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.375670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.383010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.385470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:23.397213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:23.398376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:23.399987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:23.401878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 462/927] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:23.407245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.419308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.419842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.420127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.420404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.421091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:23.421395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.422879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.425372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.430660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 466/928] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Aug 1 14:02:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:23.437839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.451894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.528846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810af-1594-4d15-998e-0aae480acb8c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.558729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb8ccd-c991-4216-aa15-499dbb5537e4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.569455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.570123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.570444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.570862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.571738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:23.572055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.573698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.592459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 463/929] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:23.593572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:23.597175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.597911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.598206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.598472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.599210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.600584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b009e-e2c5-4ff6-9c31-b3775daee97f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.690132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 467/930] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:23.709910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.718006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ec08a-7ad0-47b5-b3f6-fb4130f4130c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:23.736339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c185cb-f5cf-45a0-8192-386429b85e5a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.736728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c185cb-f5cf-45a0-8192-386429b85e5a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.737103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c185cb-f5cf-45a0-8192-386429b85e5a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.740089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 468/931] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:23.745051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.745426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.745807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.771287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:23.772088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:23.772440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:23.772788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/d6805ff422004601b0e93eb98138eaa7/roles/12445c1289fc42b48b544b615b65569a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:23.776159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=d6805ff422004601b0e93eb98138eaa7, role_id=12445c1289fc42b48b544b615b65569a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:23.776572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:23.778334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:23.778500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:23.848034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:23.867088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 469/932] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:23.878773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 464/933] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:23 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/d6805ff422004601b0e93eb98138eaa7/roles/12445c1289fc42b48b544b615b65569a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:02:23.892180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.027203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee88ee5-3e36-43bc-86de-ef41b6fae727 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.067489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.068397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.068830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.069273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.070083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.072450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-eaf34c42-14e3-4be8-afe8-e9cd32bb6828 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:24.083124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:24.084404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:24.085453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.093045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 470/934] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:24.095023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.204080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b8d6-5d73-4894-b9c5-af8888e01ba2 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.204291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b8d6-5d73-4894-b9c5-af8888e01ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.204581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b8d6-5d73-4894-b9c5-af8888e01ba2 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.206213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 471/935] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:24.211555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.211842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.212127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.212994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5063f-7ace-4301-81e4-f79c4079edec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.234036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:24.235243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:24.251655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.252439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.252821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.253198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.254007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:24.254412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.255879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.262534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 465/936] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:24.273692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.296321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:24.308372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:24.320182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 472/937] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:24.349027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.413783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802e5-8139-4c03-8cc9-9e721487b225 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.467964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.468823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.469209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.469613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.470529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:24.472104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.476570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.479350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8a301-c104-4c2e-a1c4-e9e3ba703a4e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.484090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 466/938] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:24.490013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.519565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.520811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.521277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.521977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.523325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.526180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:24.538554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:24.540353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:02:24.541235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:24.543307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 473/939] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:24.549398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.609575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:24.612441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:24.633268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937e63d-a469-4867-9331-2c11a51dae03 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.678727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.679172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.679506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.680336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.681170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] RBAC: Adding query filter params (interface=public, service_id=5c3ba4948e8949a591eb4dc4b1cce2bf, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:24.681450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.682950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.687917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ca38-3dd8-4111-bc45-cd28c52a5e8d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.693248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 467/940] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/endpoints?service_id=5c3ba4948e8949a591eb4dc4b1cce2bf&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:24.698208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.735791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.736359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.736642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.736916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.737682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:24.738007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.739374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.745552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 474/941] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:24.753724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.821809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63617173-c3e4-4ebd-a3d5-7e2f457c525a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.859776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.860793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.861299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.861816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.862664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.864245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.877551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19a51-2d05-474b-842d-747dc5c1d9b2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:24.878106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 468/942] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:02:24.889514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:24.921094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:24.921726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:24.922089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:24.922365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:24.923067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:24.923373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:24.924763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6831c61-ae37-4153-9822-176bbc5ae6f8 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:24.932518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 475/943] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:24.939300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:24.953706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:25.068215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9c13-d5ce-44a6-bce1-a48940197fa9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:25.109507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:25.110542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:25.111025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:25.111538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:25.112506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:25.114174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45871c9d-03b4-40cf-8bb1-faa5a8566edc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:25.267526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 469/944] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:25.981737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9db7-862a-4c0f-b9ae-943cb8aad54f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:25.982297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9db7-862a-4c0f-b9ae-943cb8aad54f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:25.982389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9db7-862a-4c0f-b9ae-943cb8aad54f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:25.983915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 476/945] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:25.989523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:25.990034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:25.990197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.010322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:26.011528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:26.029053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec002-4546-4e44-81cb-40ef93f5ea7c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.029243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec002-4546-4e44-81cb-40ef93f5ea7c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.029524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ec002-4546-4e44-81cb-40ef93f5ea7c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.031203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 477/946] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:26.039274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.040124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.041232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.071263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:26.073901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:26.092308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.113913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 470/947] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:26.137931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.178119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 478/948] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:26.193719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.251441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8540a38-59c5-47d2-97c4-311256e540a5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.291638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.292658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.293218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.293738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.294648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.296456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.299281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1a48-d7c8-4f66-a4ba-19fbf8403516 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.299671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING keystone.server.flask.common [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 14:02:26.301029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.337034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.338600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.339447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.339995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.352364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:26.357484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:26.358548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:26.359727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:26.362016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.sql.core [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:02:26.362016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 14:02:26.362016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [parameters: {'id': 'bf7ebf9dccf4416ea3c4ce8187b6be4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 14:02:26.362016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:02:26.363874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 479/949] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:26.364845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7ebf9dccf4416ea3c4ce8187b6be4c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7ebf9dccf4416ea3c4ce8187b6be4c. Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:02:26.387742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result.read() Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 14:02:26.388694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application yield resource Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise self.value Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application session.commit() Aug 01 14:02:26.389645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:02:26.390588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:02:26.391508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result.read() Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:02:26.394502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [parameters: {'id': 'bf7ebf9dccf4416ea3c4ce8187b6be4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.396886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:26.399013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7ebf9dccf4416ea3c4ce8187b6be4c. Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 471/950] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Aug 1 14:02:26 2022] POST /identity/v3/projects => generated 262 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:26.401385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.471507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.519846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc5ca-4fb8-43d1-b40b-ee39051e8c2a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.551068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c01202-4232-4cc0-9b94-4c4605708a69 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.559967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.560708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.561001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.561283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.562166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:26.562482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.564000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.574136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 480/951] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:26.579983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.591192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.591858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.592142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.592417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.600617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.602639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.608915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:26.616328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:26.618067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:26.619056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:26.620932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 472/952] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:26.629625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.698792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97945-dd90-4eec-96ae-558528b78cad None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.738767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.739721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.740043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.740410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.747398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1aa2f-e1fe-4b7c-a71b-0b1d6c005252 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.756406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.756988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.759152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:26.776925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:26.778155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:26.779211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:26.779211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:26.779211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:26.779211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:26.780415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 481/953] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:26.789965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:26.808657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.809657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.809975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.810263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.811007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:26.811325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.813431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.845860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 473/954] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:26.887469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:26.913990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68669a-45a6-49c6-8c8d-2210e2c52731 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:26.956966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:26.957613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:26.957938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:26.958280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:26.959007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:26.959365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:26.960800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005c679-ba56-4002-84c4-e59b320f0390 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:26.981151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 482/955] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:26.982688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.013187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6de4b-7dda-4904-b4c7-b897d091fe30 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.013878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6de4b-7dda-4904-b4c7-b897d091fe30 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.013878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6de4b-7dda-4904-b4c7-b897d091fe30 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.015519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 483/956] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:27.022543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.023176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.023860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.044198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:27.045799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:27.106967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd74b8-eb95-4b22-a41d-da86d1bbd935 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.132585 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 484/957] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:27.150988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.151996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.152285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.152593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.158608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.161272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.162753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:27.176012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:27.177040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:27.178055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 474/958] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:02:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:27.185746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.234215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.248129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.295632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912251d-34df-4bee-aafe-bc06707c96fc None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.318031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a553c7-72a0-4c6a-bc63-a4db9ba5f29d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.344694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.345438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.345827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.346178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.346880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.348880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:27.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:27.363714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:27.364573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:27.369265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 485/959] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:27.370305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.370621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.371576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.372116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.372597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.373746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:27.374355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.376030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.404010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 475/960] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:27.405891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.505664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.508734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cb02e-b18f-4102-819a-0bd6128dd908 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.523056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33267a6-00c0-4744-9e82-bf5254db1103 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.541614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.549217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.549887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.550170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.550448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.551138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:27.551444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.552832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd89b3-e987-419f-b1d7-564ee1b90023 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.562573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 486/961] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:27.562573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81eb8-d470-47af-93cb-b4b8f5a5940d None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.562573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81eb8-d470-47af-93cb-b4b8f5a5940d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.562573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81eb8-d470-47af-93cb-b4b8f5a5940d None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.562573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 487/962] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:27.564235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d81eb8-d470-47af-93cb-b4b8f5a5940d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.570882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.571633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.571921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.572197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.659892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.661638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.694964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d81eb8-d470-47af-93cb-b4b8f5a5940d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.738264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.738971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.739248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.739523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.740209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:27.740514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.741951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679a25-2e60-4e81-8d0b-75344ef69170 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.752150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 488/963] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:27.752150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.752150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.752150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.768770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:27.769734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.770007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:27.792412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 476/964] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:02:27.793802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.841276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:27.861964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 489/965] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:27.863395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:27.910319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b06a-9cd8-4920-8d46-41d2ddab33d0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:27.970932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:27.970932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:27.970932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:27.970932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:27.971849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:27.971849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:27.984285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aeb80-31cc-4a78-bb15-1e43abf6e11f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.032673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.033333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.033585 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.033885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.044209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 477/966] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:28.045476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.047067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.050891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:28.072038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:28.073208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:28.074153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:28.074153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:28.074153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:28.074153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:28.074153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 490/967] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:28.080571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.130714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:28.159103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:28.200209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3387ed-b559-4163-a171-f3c8e02a2b9e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.204525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16be3e-ed3e-4dac-ae2a-db99e9945af6 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.244673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.245347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.247269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.247269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.247269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.248936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.250837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.252252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.252252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.252252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.252801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:28.253111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.254630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:28.263664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:28.264739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:28.265590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:28.266484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 478/968] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:28.273572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.275109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 491/969] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:28.278917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.383469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:28.386156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb2bf1-be37-44d1-ac3f-d8ebf1803531 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.409397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ca6d-2c00-47b3-994a-ff1c107c0add None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.426226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:28.431361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.432208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.432666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.433093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.434176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:28.435175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.437052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.445326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 479/970] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:28.456197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.456197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.456197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.456197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.456730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.459716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.461805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:28.475416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:28.477063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:28.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:28.484140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 492/971] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:28.487596 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.588853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa881ea-5a9d-44e5-94bb-cad94215868b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.620943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fa196-a08b-4bc0-9a27-1123f100f1f3 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.625964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.626596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.626884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.627164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.627853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:28.628161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.629528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.642277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 480/972] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:28.663004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.664051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.665200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.665723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.667131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:28.667913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.669798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9a3d3-e32f-4647-a0aa-841c7f3ce0b6 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.684711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 493/973] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:28.691554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:28.730406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:28.833025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94365-ba8e-483b-b908-e5da2d459374 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:28.875415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:28.876048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:28.876330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:28.876602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:28.877400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] RBAC: Adding query filter params (role.id=12445c1289fc42b48b544b615b65569a, scope.project.id=795fb0432e984025b689745107879b62, user.id=d6805ff422004601b0e93eb98138eaa7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:28.877711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:28.879170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16156be5-9cb4-4eca-b09b-7c34b8a8d22a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:28.887276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 481/974] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:28 2022] GET /identity/v3/role_assignments?user.id=d6805ff422004601b0e93eb98138eaa7&scope.project.id=795fb0432e984025b689745107879b62&role.id=12445c1289fc42b48b544b615b65569a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:29.098268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812cc2-52e6-451c-b19d-80504be5379e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:29.098795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812cc2-52e6-451c-b19d-80504be5379e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:29.098795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812cc2-52e6-451c-b19d-80504be5379e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:29.100324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 494/975] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:29.106536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:29.106827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:29.107105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:29.126562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:29.128088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:29.219150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 482/976] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:29.244896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9812cc2-52e6-451c-b19d-80504be5379e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:29.277925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:29.373949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9812cc2-52e6-451c-b19d-80504be5379e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:29.412178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:29.412819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:29.413104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:29.413380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:29.414337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:29.415717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:29.418351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING keystone.server.flask.common [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 14:02:29.496381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.sql.core [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:02:29.496381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 14:02:29.496381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [parameters: {'user_id': 'a26b2aca7f544dc39466d6cd3acbb890', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 14:02:29.496381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result.read() Aug 01 14:02:29.505587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:02:29.506548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application yield resource Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise self.value Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application session.commit() Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:02:29.507530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:02:29.509674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:02:29.512374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application result.read() Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:02:29.514418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a26b2aca7f544dc39466d6cd3acbb890', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:29.518627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 14:02:29.520671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:29.526358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 495/977] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Aug 1 14:02:29 2022] POST /identity/v3/users => generated 160 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:29.527304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:29.554157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:29.626171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbece5b-8318-4db3-9337-8fe4fdf12e9c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:29.668921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:29.669585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:29.669904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:29.670185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:29.677984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:29.679427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f70e85ca-7f44-42f4-a478-499e6626b707 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:29.692600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:29.694827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:29.697096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 483/978] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:29.710601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:29.810301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:29.820200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35cbc-ab1b-4bc8-96c4-2811ddbc11d4 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:29.857807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:29.858831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:29.859311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:29.859781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:29.860744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:29.861338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:29.863272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6c9a-86c8-47b4-9500-e315fd73336a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:29.905497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 496/979] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Aug 1 14:02:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:30.316158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe628-4d31-42c1-a5ba-c96ae4dd54d2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.316662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe628-4d31-42c1-a5ba-c96ae4dd54d2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.316662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe628-4d31-42c1-a5ba-c96ae4dd54d2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.318208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 484/980] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:30.324716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.325176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.325252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.344169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:30.345692 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:30.425106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 497/981] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:30.448094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe628-4d31-42c1-a5ba-c96ae4dd54d2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:30.546740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:30.566526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe628-4d31-42c1-a5ba-c96ae4dd54d2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:30.604227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:30.604872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.605157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.605437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.606095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:30.607460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:30.616797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:30.618301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:30.619306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:30.620814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 485/982] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:30.625740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:30.702331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:30.737880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa52b1a-e050-4fe0-a31b-644733475e40 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:30.778544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:30.779203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.779487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.779763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.780460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:30.780760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:30.785361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5a69a-8e90-46d8-aa6f-8c5147e95aa3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:30.791698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 498/983] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:30.798286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:30.850694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cddbd-91bc-4391-9e2b-b0f4701ebc9b None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.850960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cddbd-91bc-4391-9e2b-b0f4701ebc9b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.851301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cddbd-91bc-4391-9e2b-b0f4701ebc9b None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.852953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 499/984] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:30.858282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.858620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.858904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.878247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:30.879432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:30.925097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5968-60fd-4a3a-bd9a-05d0ece7d9b0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:30.958613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 500/985] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:30.964706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:30.965326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:30.965606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:30.965911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:30.966590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:30.966889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:30.968242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:30.974004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 486/986] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:30.980682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:30.980861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:30.996075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:31.049557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:31.088772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3124359-5f14-43c0-b826-502679f03e17 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.091529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211bf2d-178c-46a3-a9c5-5ea1798fb60a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.124145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.124683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.124967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.125242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.126038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] RBAC: Adding query filter params (interface=admin, service_id=5c3ba4948e8949a591eb4dc4b1cce2bf, region_id=RegionOne) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:31.126350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.126615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.127244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.127531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.127718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ee2e-5cdc-4106-b869-f7322b3488ae None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.127811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.128497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.129895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1236e0-d484-490a-a87f-9a684a2eb79f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.133704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 501/987] 10.222.0.49 () {56 vars in 1249 bytes} [Mon Aug 1 14:02:30 2022] GET /identity/v3/endpoints?service_id=5c3ba4948e8949a591eb4dc4b1cce2bf&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:31.136487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683072a-982e-478e-950c-5a859f41e22c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.136779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683072a-982e-478e-950c-5a859f41e22c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.137062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683072a-982e-478e-950c-5a859f41e22c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.138429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 502/988] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:31.139580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683072a-982e-478e-950c-5a859f41e22c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:31.202104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 487/989] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:30 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:31.203678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.203972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.204248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.224271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:31.225504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:31.277226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683072a-982e-478e-950c-5a859f41e22c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.306815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:31.307833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:31.312955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 488/990] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:31.318928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.319798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.319896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.320198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.323002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.323002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.329944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 503/991] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:31 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:02:31.338577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:31.478435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950be7-99e3-4bfe-a708-a878b091a3e4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.520196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.520868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.521156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.521443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] PATH_INFO: `/v3/services/image` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.522146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.523692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:31.533389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:31.534622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:31.535777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 489/992] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Aug 1 14:02:31 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:31.541524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:31.654133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413c8ce-a0f1-4d0d-a7a2-c5666535de11 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.693290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.693975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.694266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.694542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.695293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] RBAC: Adding query filter params (name=image) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:31.695677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.697142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13baf4-c61d-4220-861e-d8927bfda4ab None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.702922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 504/993] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:31.709828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:31.789785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:31.833621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55744-ce72-456e-ade5-67f65acbf96a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:31.878587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:31.879208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:31.879490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:31.879762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:31.880434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:31.880737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:31.882159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5dec7-08af-414f-b542-197856fdfce6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:31.894032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 490/994] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:33.318602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6088b1-bb44-4be1-99cc-acf13b7a0147 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.319144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6088b1-bb44-4be1-99cc-acf13b7a0147 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.319144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6088b1-bb44-4be1-99cc-acf13b7a0147 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.321428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 505/995] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:33.326881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.327355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.327435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.348821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:33.350062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:33.401501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df759a88-b1f9-4236-8f8b-fbee1dad12d9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.401913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df759a88-b1f9-4236-8f8b-fbee1dad12d9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.402070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df759a88-b1f9-4236-8f8b-fbee1dad12d9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.403587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 506/996] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:33.408737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.409024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.409307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.427473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 491/997] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:33.428929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:33.430737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:33.450872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.484455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:33.510747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 507/998] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:33.522836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:33.533173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.582289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94bc48-a20a-4207-8d42-c0bd32be6c5d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:33.623391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:33.624147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.624435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.624712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.625350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:33.627024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:33.637468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:33.638591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:33.639453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 492/999] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:33.644659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.646234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360bf8-4df1-4ce4-bb25-0db3b9633c7d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:33.686051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:33.686753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.687037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.687314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.687942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:33.689317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:33.699064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:33.702974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:33.703845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 508/1000] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:33.706420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.757786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:33.779471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349313-fd9c-4abc-ba9e-060405e1ddc3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:33.805467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:33.818242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:33.819180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.819455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.819740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.820584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:33.820966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:33.822498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:33.824781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c9b8-0bdc-48b7-8078-a4b30150357d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:33.827392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 493/1001] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:33.833527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.863112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:33.863698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.864095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.864374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.865064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:33.865374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:33.866856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:33.873163 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 509/1002] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:33.878764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:33.954622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47821e-157f-45ab-9757-b066f801fb69 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:33.991699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:33.992349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:33.992706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:33.993122 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:33.993844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:33.994156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:33.995530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2597e-274f-4300-90a3-17e11c1dcf0f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:33.996724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32238-ca3d-43af-846f-8487be49ea0e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:34.000651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 494/1003] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:34.001932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b116-7d69-446d-aa16-0743915b66a3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.002227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b116-7d69-446d-aa16-0743915b66a3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.002507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b116-7d69-446d-aa16-0743915b66a3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.003908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 495/1004] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:34.006680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56b116-7d69-446d-aa16-0743915b66a3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:34.010046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.034918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:34.035548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.035836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.036180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.036867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:34.037177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:34.038579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645964d-8604-4dc3-8543-aa136ff4e7f4 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:34.044778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 510/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Aug 1 14:02:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:34.045900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567484-b437-4990-8e82-be362fe9d832 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.046189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567484-b437-4990-8e82-be362fe9d832 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.046467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567484-b437-4990-8e82-be362fe9d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.063074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.065959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-25567484-b437-4990-8e82-be362fe9d832 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:34.067178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-25567484-b437-4990-8e82-be362fe9d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:34.116518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56b116-7d69-446d-aa16-0743915b66a3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:34.140731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 511/1006] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:34.141554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25567484-b437-4990-8e82-be362fe9d832 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:34.163641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:34.164879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.165232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.165509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.166290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] RBAC: Adding query filter params (interface=public, service_id=ecfe140dcf914828b04cae695bb0de68, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:34.166600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:34.167956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:34.173511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 496/1007] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:34 2022] GET /identity/v3/endpoints?service_id=ecfe140dcf914828b04cae695bb0de68&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:34.178823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:34.250878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25567484-b437-4990-8e82-be362fe9d832 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:34.254031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.285313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855397f0-6a4b-49a4-953c-b565bccb428d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:34.290741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:34.291378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.291664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.291944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.292664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:34.294078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:34.299540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:34.321668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:34.322321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.322608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.322888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.323576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:34.324951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23447db7-6257-457b-bf97-15f456f0f237 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:34.361238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 512/1008] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:34.362185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:34.420262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 497/1009] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:34 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:34.500671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326606be-485a-4305-b1e4-8cfcf5bbb815 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:34.553090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:34.553791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:34.554089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:34.554359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:34.555135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:34.556612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad55b9f-6fc4-4fd4-83b9-9f3940a7848e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:34.564308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 513/1010] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:34 2022] GET /identity/v3/services => generated 1957 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:02:36.453695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49508-ebed-4fe4-8ab7-775f26791dc7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.454262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49508-ebed-4fe4-8ab7-775f26791dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.454262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49508-ebed-4fe4-8ab7-775f26791dc7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.455673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 498/1011] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:36.461334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.462020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.462154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.483883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:36.485081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:36.500712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:36.504749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5819f4-ecd7-41ab-93f5-c3feac028eed None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.504896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5819f4-ecd7-41ab-93f5-c3feac028eed None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.505103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5819f4-ecd7-41ab-93f5-c3feac028eed None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.506520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 499/1012] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:36.512493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.512735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.512967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.531648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:36.532828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:36.563613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 514/1013] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:36.587660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:36.610493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 500/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:36.636734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:36.699640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d6908-caa1-4421-b883-24b1a84c1aa3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:36.736231 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea320695-1764-4691-b179-c717b1638304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:36.736797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320695-1764-4691-b179-c717b1638304 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.737077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320695-1764-4691-b179-c717b1638304 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.737351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320695-1764-4691-b179-c717b1638304 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.738862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320695-1764-4691-b179-c717b1638304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:36.740304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320695-1764-4691-b179-c717b1638304 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:36.740910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f78f-228a-426c-b02b-593b0160a681 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:36.742188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 515/1015] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:36.743426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6964d-536b-404b-bcd4-e1a25b210c8c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.743715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6964d-536b-404b-bcd4-e1a25b210c8c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.743996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6964d-536b-404b-bcd4-e1a25b210c8c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.745227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 516/1016] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:36.748129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:36.751323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6964d-536b-404b-bcd4-e1a25b210c8c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:36.770741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:36.786360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:36.787076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.787368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.787640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] PATH_INFO: `/v3/services/image` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.788277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:36.789851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-2c9fdfbe-4b35-4229-84a5-cc300503dd33 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:36.799030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:36.800281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:36.801184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 501/1017] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Aug 1 14:02:36 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:36.802028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.802028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.802437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.825147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:36.826400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:36.872811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6964d-536b-404b-bcd4-e1a25b210c8c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:36.907387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 502/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:36.908607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:36.910891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:36.911517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:36.911801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:36.912077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:36.912767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:36.914375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.014838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.018742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a289f2b-5325-4de6-baba-b0907b073675 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.024376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 517/1019] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:02:36 2022] POST /identity/v3/projects => generated 311 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:37.025335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.057870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.058515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.058799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.059178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.059919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] RBAC: Adding query filter params (name=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:37.060253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.061722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.072903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 503/1020] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:37.074119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.117811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.157192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924304-eb60-4792-95f9-ab8002f95472 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.197713 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb7a48-ea0c-4d1a-9d92-7a349b802689 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.204917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.204917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.204917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.205443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.205839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.207204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:37.217496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:37.218629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:37.219496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 518/1021] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:37.225827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.244111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.244363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.244545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.244807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.245548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] RBAC: Adding query filter params (type=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:37.245919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.247385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.255032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 504/1022] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:37.262019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.290908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.350467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3c7f7-d346-4c3e-9ac7-920ba07eb09f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.371775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff03c9-f33f-461c-bb84-30dfe82598ec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.395445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.396133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.396420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.397134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.397849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:37.398182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.400201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.401317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.406020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 519/1023] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:37.411765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.421217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.422116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.422560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.422842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.423609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] RBAC: Adding query filter params (interface=public, service_id=ee5407f274504909bf115c5623fe3421, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:37.423921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.425300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.431723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 505/1024] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/endpoints?service_id=ee5407f274504909bf115c5623fe3421&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:37.437121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.532946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a725-e321-475d-a31d-046519c193b5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.555954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.568164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4522-93b3-44fd-8eac-897c8357cb4a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.569568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.570926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.571274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.572568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.572568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] RBAC: Adding query filter params (type=compute) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:37.572749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.574192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.584723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 520/1025] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:37.586787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:37.618088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.618735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.619019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.619300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.619967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.621349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e56da-8faf-4bf5-a949-233a90e9d32a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.628199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 506/1026] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:02:37 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:02:37.683113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:37.733790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0487fcb-9abd-4d95-9975-be23aee13ead None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:37.796920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:37.797563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:37.797871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:37.798146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:37.798875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:37.800264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55253ba-d4e4-40f0-ad60-c7ade11c74c9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:37.885474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 521/1027] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:39.186663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cddc1-ee65-4b79-9ae7-10cfe3761a19 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.187208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cddc1-ee65-4b79-9ae7-10cfe3761a19 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.187208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cddc1-ee65-4b79-9ae7-10cfe3761a19 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.188873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 507/1028] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:39.194577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.195581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.196122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.216576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:39.218280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:39.308638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 522/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:39.332995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cddc1-ee65-4b79-9ae7-10cfe3761a19 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:39.445186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cddc1-ee65-4b79-9ae7-10cfe3761a19 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:39.483559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:39.484214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.484496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.484774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.486064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:39.487418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea5a4f-170a-4215-adb1-85cdf48be671 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:39.494169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 508/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:39.495932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:39.550444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:39.612260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc7983-2d40-45ed-ad5b-8b323f84f442 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:39.651052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:39.651682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.651963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.652235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.652935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:39.654404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:39.731517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be2d8-eab7-4fa3-bcfd-2b31c24fce3b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.731731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be2d8-eab7-4fa3-bcfd-2b31c24fce3b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.732013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be2d8-eab7-4fa3-bcfd-2b31c24fce3b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.733372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 509/1031] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:39.738771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:39.739058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:39.739334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:39.761454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:39.761454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:39.766342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 523/1032] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:02:39 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:39.787123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:39.854269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 510/1033] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:39.877823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:39.995137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:39.998605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a39f1-6642-4af5-8ae9-b8aa100e4862 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.037613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.038295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.038572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.038912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] PATH_INFO: `/v3/services/image` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.039686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.041066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-7b66631a-02f6-4f22-a852-7a55a8284aaa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:40.051025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:40.056374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:40.057251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 524/1034] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Aug 1 14:02:39 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:40.059334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.068810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349fc4-6fe5-454a-80c8-f6bd41596a2a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.069135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349fc4-6fe5-454a-80c8-f6bd41596a2a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.069368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349fc4-6fe5-454a-80c8-f6bd41596a2a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.071682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 525/1035] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:40.077280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.077503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.078742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.097171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:40.098398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:40.174360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 526/1036] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:40.177015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cc73e-7ca7-4aca-9ef7-14480f672663 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.198187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.220362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.221277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.221566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.221883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.222747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] RBAC: Adding query filter params (name=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:40.223407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.224795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.230897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 511/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:40.237459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.263775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:40.309256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:40.317484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f5c4-3f90-477e-a665-da470c557c93 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.360741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.361401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.361687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.361901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37439f1-27ce-4e28-acd2-c54d922ce753 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.362059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.374990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:40.380025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:40.381001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:40.382719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 527/1038] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:40.387786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.403879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.404614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.404911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.405186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.405919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] RBAC: Adding query filter params (type=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:40.406203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.407649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.413108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 512/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:40.420011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.511044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57343fe8-693c-48e8-ba2a-a4fd16ced85d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.516065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:40.535438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533e13-85eb-441a-9089-aa0319625b27 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.550793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.551425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.551707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.551981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.552706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:40.553010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.555044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.569337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 528/1040] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:40.570244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.578134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.578767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.579048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.579322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.580047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.581936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.591885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:40.684430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938b4d-0541-4bc2-a118-00eeb98ff81a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.706679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 513/1041] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:02:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:02:40.736298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.737020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.737302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.737575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.750208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.751703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:40.774669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:40.775655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:40.784752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:40.784752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:40.784752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:40.784752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:40.784752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 529/1042] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:40.785045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:40.938877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d535b-7842-43fb-827b-41dfc6732842 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:40.988984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:40.989634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:40.989945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:40.990228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:40.990935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:40.991239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:40.992668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:40.995651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:41.006790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 514/1043] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:41.013989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:41.093396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:41.138549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9d9b-1c69-4218-8d51-099d725eeb22 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:41.175715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:41.176400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.176696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.176977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.186946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:41.188466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:41.201706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:41.203216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:41.204668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:41.205839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 530/1044] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:02:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:41.208727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:41.321396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b12f-cb8c-43fe-83c4-d0d0a94d724e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:41.362183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:41.362727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.363014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.363296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.364106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:41.364419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:41.365880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:41.387227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 515/1045] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:02:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:41.392760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:41.515460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061922cb-3ed7-4465-ae62-233a11d0baab None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:41.541994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:41.553385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:41.554042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.554324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.555567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.633044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:41.634953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bd8b4-734a-4665-962d-634e98dfb284 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:41.748366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 531/1046] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:41.754002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:41.838178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:41.892283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661155-4503-4aeb-9491-f3eb058b0594 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:41.911208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635748a8-cd88-4fb7-ab79-f1ea2f4d0fbb None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.911504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635748a8-cd88-4fb7-ab79-f1ea2f4d0fbb None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.911773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635748a8-cd88-4fb7-ab79-f1ea2f4d0fbb None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.913153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 532/1047] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:41.918588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.918875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.919157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.932873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:41.933530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:41.933830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:41.934109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:41.937504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:41.938773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:41.944763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:41.947479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:41.958053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:41.963862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:41.970786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:41.971724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:41.971724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:41.971724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:41.971724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:41.971724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 516/1048] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:41.976769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.033795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 533/1049] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:42.049356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.098105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3633c-3ad9-41ef-818d-096b718d2465 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.105636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.142398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.143031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.143316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.143601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.144381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:42.144686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.146078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.159457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 517/1050] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:42.165027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952161fe-f9bd-4579-8414-06538a178e34 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.165201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.213411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.214996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.215460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.215883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.227789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:42.232950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:42.234713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:42.236210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 534/1051] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:42.240107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.259763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.287632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c29af-9f26-4589-92f9-08181afdd9da None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.331306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.332016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.332242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.332514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.340761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.342270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:42.354430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:42.355430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:42.356346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 518/1052] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:42.359476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4543-c58e-415b-8776-e1171b9f3e24 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.361549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.394077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.402383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.403022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.407471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.407471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.407471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:42.407471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.407471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.416519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 535/1053] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:42.422456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.487012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb652e-88c5-480c-926f-7cebac704679 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.513936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.532492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.533717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.534244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.534822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.536344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:42.536817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.538030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0649-da27-4dc8-93b1-7ee846cf889c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.538655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.565043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 519/1054] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:42.566620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.586356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.587018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.587306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.587584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] PATH_INFO: `/v3/users/a228a8f472c54a6db5e88c91adbe8d60` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.606746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] RBAC: Authorizing `identity:get_user(user_id=a228a8f472c54a6db5e88c91adbe8d60)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.608193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.613833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 536/1055] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/users/a228a8f472c54a6db5e88c91adbe8d60 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:42.615933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:42.675159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.694006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4dec-cc34-4c33-a3ce-d4a572d57686 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.736059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.736716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.737000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.737277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.738111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] RBAC: Adding query filter params (role.id=12445c1289fc42b48b544b615b65569a, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:42.738420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.739897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeeffa-3a22-4be3-a8dd-5f8b1331484c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.741477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efac837-30cc-4b76-ab3e-f2af9246b28e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:42.746984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 520/1056] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=12445c1289fc42b48b544b615b65569a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:42.795901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:42.796551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.796838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.797112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.800484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:42.827841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c80dd-c595-4b35-801c-fa110f65b0b0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.828132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c80dd-c595-4b35-801c-fa110f65b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.828414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c80dd-c595-4b35-801c-fa110f65b0b0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.830024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 521/1057] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:42.837281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:42.837281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:42.837281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:42.858104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:42.861251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:42.906712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:42.908179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:42.955855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 522/1058] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:42.979956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:43.031889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 537/1059] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:02:43.037490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:43.076110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:43.090175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:43.112944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec5fb-485e-4ab8-b7e3-029add561be7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:43.152573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:43.153207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:43.153530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:43.153856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:43.154936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298e07-7dc8-4709-b528-0439c59e3e9e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:43.193856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:43.194520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:43.194807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:43.195841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:43.198301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:43.199759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:43.201655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 538/1060] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:02:43 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:43.207581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:43.234760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:43.236222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:43.325915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:43.339231 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757842a5-23c2-46a4-8eb1-a9e743c59431 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:43.341622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:43.347647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 523/1061] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:43.355756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:43.385982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:43.386628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:43.386897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:43.387186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:43.387964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9, user.id=a228a8f472c54a6db5e88c91adbe8d60) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:43.388277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:43.389701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:43.405791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 539/1062] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:43 2022] GET /identity/v3/role_assignments?user.id=a228a8f472c54a6db5e88c91adbe8d60&scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:43.479077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f77b46-efa8-492c-80de-22403a9662f8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:43.530193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:43.530863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:43.531147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:43.531420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:43.543803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:43.545299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-561abdc2-c48a-40d6-a890-b1b891916e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:43.563520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:43.564492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:43.565411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:43.565411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:43.565411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:43.565411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:43.565411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 524/1063] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:43.574028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:43.687259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e872-8661-4624-b082-977accb2b13d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:43.725168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:43.725816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:43.726101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:43.726967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:43.728020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:43.728326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:43.729945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb753d-e05f-42dc-8b99-32e0b1eeedcb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:43.749786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 540/1064] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:44.811284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d5b8-9555-41e4-85ba-6c40fa05e56c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:44.811837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d5b8-9555-41e4-85ba-6c40fa05e56c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:44.811837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d5b8-9555-41e4-85ba-6c40fa05e56c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:44.813198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 525/1065] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:44.818934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:44.819410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:44.819505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:44.839639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:44.840886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:44.862206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:44.911085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 541/1066] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:44.933548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224d5b8-9555-41e4-85ba-6c40fa05e56c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:44.971737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:45.048128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224d5b8-9555-41e4-85ba-6c40fa05e56c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.083260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.083908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.084257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.084536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.096160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:45.101077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:45.102492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:45.103342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 526/1067] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:45.111064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.232359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306a893-2e0f-485c-a8f0-d8a3e9213996 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.271944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.272547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.273690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.273690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.273937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:45.274185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:45.275547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0e3d-3bb4-476f-9ccc-3b80cd5d36b3 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:45.284408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 542/1068] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:45.290706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.415190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:45.424366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433a01-9c4f-4738-aa40-1621786daa66 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.464635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63797a49-6742-4e7a-b262-11696990021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.465286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797a49-6742-4e7a-b262-11696990021c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.465569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797a49-6742-4e7a-b262-11696990021c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.465873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797a49-6742-4e7a-b262-11696990021c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.478224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63797a49-6742-4e7a-b262-11696990021c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:45.479985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63797a49-6742-4e7a-b262-11696990021c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:45.483255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b5a8-2b74-4d61-a7e1-caa844a9a6b8 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.483547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b5a8-2b74-4d61-a7e1-caa844a9a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.483828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b5a8-2b74-4d61-a7e1-caa844a9a6b8 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.485198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 543/1069] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:02:45.490682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.490973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.491259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-63797a49-6742-4e7a-b262-11696990021c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:45.497539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:45.498638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:45.499669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:45.499669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:45.499669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:45.499669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:45.499669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 527/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:45.504753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63797a49-6742-4e7a-b262-11696990021c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.515166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:45.517034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:45.548682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:45.623923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 544/1071] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:45.633371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63797a49-6742-4e7a-b262-11696990021c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.649863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.679195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.680497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.680789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.681166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.682391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:45.682709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:45.684727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:45.700169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 528/1072] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:45.706020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.711169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:45.770793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97938ce-1f23-4000-ae6e-ca8d65059ad5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.817551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.818535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.818817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.819136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.831223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:45.836471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f57ff8-6dad-4e33-a404-8ad192d228c0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:45.841534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:45.842846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:45.843774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 545/1073] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:45.848927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.863238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:45.890590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:45.891394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:45.891711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:45.892172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:45.901746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:45.903248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:45.918568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:45.919987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:45.920938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 529/1074] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:45.927620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:45.992616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549948f-9a90-4915-b224-009337a442c8 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.005488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.041010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.042003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.042295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.042578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.043594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:46.044123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.045588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.055337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 546/1075] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:46.055691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7434-165f-4602-9dfe-9dab17f6b7a7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.061679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.096873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.097499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.097814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.098110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.098912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:46.099222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.100664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.123453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 530/1076] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:02:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:46.130244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.138064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.176765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce077a-40db-40ad-905b-9632a9123f58 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.219492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.220147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.220435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.220714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] PATH_INFO: `/v3/users/a228a8f472c54a6db5e88c91adbe8d60` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.221947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] RBAC: Authorizing `identity:get_user(user_id=a228a8f472c54a6db5e88c91adbe8d60)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.223389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.225035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 547/1077] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/users/a228a8f472c54a6db5e88c91adbe8d60 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:46.231932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.252572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa11a63-13a5-415e-ac49-fd2f9605a7a1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.278967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.296021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.296677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.296959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.297242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.307748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.309219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:46.325569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:46.326761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:46.327865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:46.327865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:46.327865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:46.327865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:46.327865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 531/1078] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:46.332484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.347757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c52f47-b4dd-49f5-adb4-40f8315eb83a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.392680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.393329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.393607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.393919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.395201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.396638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.399494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 548/1079] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:46.405843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.415217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.442826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba608ff7-ab9b-4666-829b-334c18eeac69 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.480999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.481637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.481956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.482239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.482941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:46.484085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.484656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.497541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 532/1080] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:46.503199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.516747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4ca8-d083-4c27-829e-bc0e388ff18b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.538449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.555830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.556510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.556793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.557061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9/users/a228a8f472c54a6db5e88c91adbe8d60/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.559055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c9713d48a499bb6011c2594c3f0c9, user_id=a228a8f472c54a6db5e88c91adbe8d60, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.560494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.610048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88726bd-9048-4947-9224-d6d8cb77560d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.647354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.648929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.649445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.649963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.653893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 549/1081] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:46 2022] PUT /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9/users/a228a8f472c54a6db5e88c91adbe8d60/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:02:46.661435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.662964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:46.676793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:46.678027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:46.678989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 533/1082] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:46.685649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.765327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.806762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90833e-3dbc-44d4-86e1-a8227bf68ab0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:46.844807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:46.845440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:46.845696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:46.845995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:46.846748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:46.847055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:46.848471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7138f0-9fe3-42d2-a667-dea5a73b5d57 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:46.861294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 550/1083] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:46.867473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:46.962026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:46.969307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63149-1e3a-4d14-b502-e3932c8838cc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:47.005709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:47.006419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:47.006705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:47.006981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/12445c1289fc42b48b544b615b65569a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:47.012580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=4b73ce0aeb0846d88bf3e4b21405eda3, role_id=12445c1289fc42b48b544b615b65569a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:47.014114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842768b-8e8f-483d-8405-92d6fa68ba15 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:47.109154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 534/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:46 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/4b73ce0aeb0846d88bf3e4b21405eda3/roles/12445c1289fc42b48b544b615b65569a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:02:48.692504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d322-0b97-49f8-a216-4dc05dca2e75 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:48.693047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d322-0b97-49f8-a216-4dc05dca2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:48.693047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d322-0b97-49f8-a216-4dc05dca2e75 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:48.694447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 551/1085] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:48.700971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:48.703626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:48.703626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:48.720633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:48.721887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:48.795004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 535/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:48.817661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d322-0b97-49f8-a216-4dc05dca2e75 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:48.921512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d322-0b97-49f8-a216-4dc05dca2e75 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:48.948267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:48.956617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:48.957263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:48.957584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:48.957856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:48.968110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-e0a27220-048e-48da-aa59-1a1684b5620a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:48.973019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:48.974162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:48.975029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 552/1087] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:48.980536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.067610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.085367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698611e5-63a1-45a5-8548-c718f6c1f61d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.123945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.124571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.124853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.125125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.125875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:49.126204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.127541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.137339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 536/1088] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:49.137778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccadc-7367-466f-a218-f5ca01b2e41d None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.138668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccadc-7367-466f-a218-f5ca01b2e41d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.138966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cccadc-7367-466f-a218-f5ca01b2e41d None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.140324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 553/1089] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:49.143200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.145334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.145612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.145910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.164589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:49.165911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:49.239374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 554/1090] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:02:49.258275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d943-c9fb-4faa-9692-ae527ab16087 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.263116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.293283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.293976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.294261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.294538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] PATH_INFO: `/v3/users/a228a8f472c54a6db5e88c91adbe8d60` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.295720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] RBAC: Authorizing `identity:get_user(user_id=a228a8f472c54a6db5e88c91adbe8d60)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.297145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.298784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 537/1091] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/users/a228a8f472c54a6db5e88c91adbe8d60 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:49.305606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.322067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.374481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a06a5-108c-4744-b5f6-be85c81cf2f1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.393921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.412726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.413367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.413688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.414047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.421934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1273b6-8553-476c-8e2c-fc230a44104b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.425233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:02:49.430747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:49.431753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:49.432772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 555/1092] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:49.438070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.457045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.457666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.457977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.458254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.530916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.532388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.542617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a0c3-487f-44f2-905b-dd26c5a34d30 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.547460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.581774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.582423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.582706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.582984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.583695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:49.583995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.585367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.594606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 556/1093] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:49.600038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.643530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.645136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 538/1094] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:02:49.651155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.712378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f9f8-6193-4f3f-8b95-5b15e07ca6c9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.748698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.749347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.749634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.749940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.761444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831517e-7e77-449c-9e20-e78cce48440b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.764674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.766792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.778047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:49.783122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:49.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:49.785500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:49.785500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:49.785500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:49.785500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:49.785500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 557/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:49.790085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.803608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.804789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.805095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.805566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.806887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.808427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.810756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 539/1096] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:49.816430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.885951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:49.903453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1bd46-1422-4fd8-89d3-902467b8242f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.925501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae80ab-b9de-4247-a03c-ca0b3ec6c337 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:49.938591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.939210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.939491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.939810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.940495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:49.940802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.942199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.954165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 558/1097] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:49.959803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:49.967313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:49.967947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:49.968233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:49.968509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:49.969305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9, user.id=a228a8f472c54a6db5e88c91adbe8d60) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:49.969621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:49.971094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:49.978399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 540/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/role_assignments?user.id=a228a8f472c54a6db5e88c91adbe8d60&scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:02:50.077044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1645c-7e2c-4967-a63d-396b09c9a6f9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:50.114932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:50.115587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:50.115866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:50.116136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:50.125574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:50.127080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:02:50.147368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:50.149338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:02:50.150703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 559/1099] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Aug 1 14:02:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:02:50.154583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:50.206008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:50.261554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007486-9e27-42e2-83b6-537814f3e0d5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:50.296263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:50.296897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:50.297184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:50.297462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:50.298296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:50.298614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:50.300051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:50.319175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 541/1100] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Aug 1 14:02:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:50.325835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:50.339310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:50.432986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64517aa3-9b0c-4e03-b32a-0fe99199469d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:50.468836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:50.469457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:50.469734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:50.470037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:50.541954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:50.543410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:50.555664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:50.645727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 560/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:50.652747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:50.759614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730bac8-9413-4802-9d78-444441f99dae None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:50.762554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:50.806493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:50.807146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:50.807424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:50.807696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:50.818443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:50.820522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:02:50.837810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:50.838869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:50.839954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:02:50.839954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:02:50.839954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:02:50.839954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:50.839954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 542/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:50.844902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:50.955695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f62ef6-93bd-497b-9fe5-970435fc905a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:50.967194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:50.993202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:50.993861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:50.994145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:50.994424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:50.995121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:50.995471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:50.996808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:51.014065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 561/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:51.015353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:51.122690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee22cc-22d3-4066-bcac-bafb43cf7615 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:51.160905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:51.161558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:51.161880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:51.162161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:51.169555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:51.171054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:02:51.184220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:02:51.185178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:02:51.186136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 543/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:02:51.191293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:51.303546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0c96-6e33-4154-87a6-00843e9c490d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:51.340141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:51.340762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:51.341044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:51.341318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:51.342098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:51.342402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:51.343815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bc544-d2c7-4fbc-8d57-5ce200b6ac41 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:51.356806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 562/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:51.362879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:51.382212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:51.470750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88116c77-8bc9-4ce0-a3d5-06c0d14ba0d1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:51.505802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:51.506429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:51.506715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:51.506993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:51.507792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] RBAC: Adding query filter params (role.id=12445c1289fc42b48b544b615b65569a, scope.project.id=795fb0432e984025b689745107879b62, user.id=4b73ce0aeb0846d88bf3e4b21405eda3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:51.508103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:51.510030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed908ab-572a-4936-a2c1-72da4c762783 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:51.516276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 544/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:51 2022] GET /identity/v3/role_assignments?user.id=4b73ce0aeb0846d88bf3e4b21405eda3&scope.project.id=795fb0432e984025b689745107879b62&role.id=12445c1289fc42b48b544b615b65569a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:52.087277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0c87-df8e-41ed-aa3a-0e30cd751f92 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:52.087813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0c87-df8e-41ed-aa3a-0e30cd751f92 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:52.087813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0c87-df8e-41ed-aa3a-0e30cd751f92 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:52.089202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 563/1107] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:52.094926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:52.095386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:52.095474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:52.115116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:52.116323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:52.195288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 545/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:52.222146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0c87-df8e-41ed-aa3a-0e30cd751f92 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:52.260109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:52.339160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0c87-df8e-41ed-aa3a-0e30cd751f92 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:52.375164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:52.375819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:52.376105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:52.376383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:52.377559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:52.379033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03076-4be6-41aa-a2a6-90ce683f8c7f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:52.380668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 564/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:52.387443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:52.401340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:52.495959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3bf7d-b805-4236-a3c9-c8d36ef01a79 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:52.531166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:52.531787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:52.532065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:52.532336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:52.533015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:52.534475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbabc9d-c8f6-49f7-83b2-ffeaca807f48 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:52.641346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 546/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:02:52 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:02:54.723513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959197-8bc9-4746-a78d-a4a27cf04c08 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:54.724054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959197-8bc9-4746-a78d-a4a27cf04c08 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:54.724054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959197-8bc9-4746-a78d-a4a27cf04c08 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:54.725417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 565/1111] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:54.731618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:54.732106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:54.732195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:54.753954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:54.755263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:54.819194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:54.827070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 547/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:54.851860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959197-8bc9-4746-a78d-a4a27cf04c08 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:54.952824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:54.957621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959197-8bc9-4746-a78d-a4a27cf04c08 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:54.993571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:54.994168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:54.994451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:54.994729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] PATH_INFO: `/v3/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:54.996425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] RBAC: Authorizing `identity:get_role(role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:54.997832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:54.999243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 566/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:54 2022] GET /identity/v3/roles/b43b05a5c1b8468d880c67404b4f733e => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:55.005202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:55.108512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62698e3-f75d-4bd4-a489-f87841ea00ad None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:55.143006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:55.143660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:55.143942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:55.144220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] PATH_INFO: `/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:55.160303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] RBAC: Authorizing `identity:get_user(user_id=804d0b85dd3c44e6a5588d68ecc5fca3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:55.161843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:55.163640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 548/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:55 2022] GET /identity/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:55.170234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:55.275806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cee3de-66d0-4879-b4c9-6148fa1cd426 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:55.310262 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:55.310878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:55.311157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:55.311430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:55.346112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:55.382010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:55.384746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:55.486933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 567/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:02:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:55.492929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:55.549629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:55.594290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e58be6-174d-4477-9f61-ae8abe0775dd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:55.628275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:55.628922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:55.629206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:55.629482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:55.630663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:55.632085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba26430-306f-4695-acd0-1830bb4f7889 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:55.633839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 549/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:02:55 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:55.640461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:55.707729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:55.744978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ec12-39c7-4d31-bf08-a28af2898085 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:55.780926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:55.781553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:55.781873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:55.782152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:55.782946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9, user.id=804d0b85dd3c44e6a5588d68ecc5fca3) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:02:55.783261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:55.784697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9236-6a1f-4ec5-b670-f6caefa58542 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:55.791355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 568/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:02:55 2022] GET /identity/v3/role_assignments?user.id=804d0b85dd3c44e6a5588d68ecc5fca3&scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:57.824495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87924-199f-4043-9a1f-e5a4edbd46df None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:57.825039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87924-199f-4043-9a1f-e5a4edbd46df None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:57.825039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87924-199f-4043-9a1f-e5a4edbd46df None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:57.826449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 550/1118] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:02:57.831720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:57.832172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:57.832263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:57.853660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:02:57.854914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:02:57.921372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 569/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:02:57.943555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87924-199f-4043-9a1f-e5a4edbd46df None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:58.056240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87924-199f-4043-9a1f-e5a4edbd46df None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:58.078588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:58.090802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:58.091444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:58.095429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:58.095429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] PATH_INFO: `/v3/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:58.095429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] RBAC: Authorizing `identity:get_role(role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:58.095429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:58.096199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 551/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:57 2022] GET /identity/v3/roles/b43b05a5c1b8468d880c67404b4f733e => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:58.103295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:58.162930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:58.206120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d3c7-7a1d-4c4d-8e5d-70adca042db8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:58.241536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:58.242217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:58.242505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:58.242786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] PATH_INFO: `/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:58.243947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] RBAC: Authorizing `identity:get_user(user_id=804d0b85dd3c44e6a5588d68ecc5fca3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:58.245435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:58.247085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 570/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:02:58 2022] GET /identity/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:58.252873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:58.356046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb73b0-97fe-45c1-a504-4ffaa02bcaa5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:58.390845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:58.391496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:58.391780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:58.392065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:58.393220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:58.394678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af678088-e557-4048-adfa-523f0c9527cd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:58.396339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 552/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:02:58 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:02:58.402568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:02:58.504971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057ffdf-1048-406a-8423-947107e8f2b8 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:02:58.531447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:58.539570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:02:58.540919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:02:58.541077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:02:58.541358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9/users/804d0b85dd3c44e6a5588d68ecc5fca3/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:02:58.547000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c9713d48a499bb6011c2594c3f0c9, user_id=804d0b85dd3c44e6a5588d68ecc5fca3, role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:02:58.547000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba74b9-124c-4c23-87ed-58af9d1bf02f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:02:58.663200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 571/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:02:58 2022] PUT /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9/users/804d0b85dd3c44e6a5588d68ecc5fca3/roles/b43b05a5c1b8468d880c67404b4f733e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:03:00.670095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43576-0aca-4431-a601-08e8fead65a1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:00.670964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43576-0aca-4431-a601-08e8fead65a1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:00.671125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43576-0aca-4431-a601-08e8fead65a1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:00.672535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 553/1124] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:00.678156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:00.678665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:00.678790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:00.697619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:00.698844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:00.764592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 572/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:00.787848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd43576-0aca-4431-a601-08e8fead65a1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:00.848355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:00.890151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd43576-0aca-4431-a601-08e8fead65a1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:00.925673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:00.926262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:00.926548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:00.926828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] PATH_INFO: `/v3/roles/b43b05a5c1b8468d880c67404b4f733e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:00.928282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] RBAC: Authorizing `identity:get_role(role_id=b43b05a5c1b8468d880c67404b4f733e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:00.929651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:00.931376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 554/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:00 2022] GET /identity/v3/roles/b43b05a5c1b8468d880c67404b4f733e => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:00.937555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:01.042648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545fb06-a94a-4f81-8227-e2311559e0c4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:01.060629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:01.079271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:01.079913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:01.080195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:01.080469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] PATH_INFO: `/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:01.081620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] RBAC: Authorizing `identity:get_user(user_id=804d0b85dd3c44e6a5588d68ecc5fca3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:01.083069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:01.084719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 573/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:00 2022] GET /identity/v3/users/804d0b85dd3c44e6a5588d68ecc5fca3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:01.091072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:01.190157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942aca-94c4-4e75-be5c-8766970cf2ff None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:01.216344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:01.224801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:01.225424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:01.226935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:01.226935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:01.293954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:01.295432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:01.392221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 555/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:01.398186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:01.500320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a494-e0dc-422a-b671-f9474c00c863 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:01.534285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:01.534926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:01.535205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:01.535477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] PATH_INFO: `/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:01.536629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c9713d48a499bb6011c2594c3f0c9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:01.538077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d7d0-6254-4dad-a7bd-15a65699736b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:01.540261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 574/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:01 2022] GET /identity/v3/projects/ce9c9713d48a499bb6011c2594c3f0c9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:01.546516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:01.575201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:01.650028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04d121-efc5-435b-ac71-2cea8cfa0fbc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:01.684533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:01.685216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:01.685431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:01.685711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:01.686535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] RBAC: Adding query filter params (role.id=b43b05a5c1b8468d880c67404b4f733e, scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9, user.id=804d0b85dd3c44e6a5588d68ecc5fca3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:01.686851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:01.688286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a4d6-06d8-4f78-b709-7b5bce5aaecc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:01.694245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 556/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:03:01 2022] GET /identity/v3/role_assignments?user.id=804d0b85dd3c44e6a5588d68ecc5fca3&scope.project.id=ce9c9713d48a499bb6011c2594c3f0c9&role.id=b43b05a5c1b8468d880c67404b4f733e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:03.775616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c876a2-0c72-4bc2-9746-7708d767d68b None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:03.776112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c876a2-0c72-4bc2-9746-7708d767d68b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:03.776221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c876a2-0c72-4bc2-9746-7708d767d68b None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:03.777582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 575/1131] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:03.783068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:03.783546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:03.783638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:03.803247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:03.804453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:03.877573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 557/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:03.902078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c876a2-0c72-4bc2-9746-7708d767d68b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:03.959589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:04.009159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c876a2-0c72-4bc2-9746-7708d767d68b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:04.043867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:04.044435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:04.044717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:04.044997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:04.046390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:04.047640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d789f5-9d18-4c18-9049-c0d06d8b69cb None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:04.049238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 576/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:04.055306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:04.076465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:04.157874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a9f6-89b1-4c42-b6b1-cb4ca93be32f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:04.192955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:04.193573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:04.193884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:04.194162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:04.194855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:04.196830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38657289-b323-4555-9ecf-ec937160f580 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:04.285169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 558/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:03:04 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:03:06.340337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b28b-f1d2-48b7-995a-71181fd7c2fa None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:06.340939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b28b-f1d2-48b7-995a-71181fd7c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:06.340939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b28b-f1d2-48b7-995a-71181fd7c2fa None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:06.342275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 577/1135] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:06.347274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:06.347692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:06.347843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:06.366597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:06.367812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:06.439052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 559/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:06.464084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b28b-f1d2-48b7-995a-71181fd7c2fa None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:06.571723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b28b-f1d2-48b7-995a-71181fd7c2fa None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:06.595791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:06.607898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84719056-f70c-4fab-b37e-be0f369bc12c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:06.615797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 578/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:03:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:06.619385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:06.621676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:06.722846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841be965-63a7-417c-bd85-a1fbd28dd5b1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:06.756242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:06.756858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:06.757131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:06.757435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:06.758808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:06.761076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48658a28-76e5-45c1-890d-921f2ac40e28 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:06.858802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 560/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:03:06 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:03:08.921241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e88e-8428-43e4-8a40-2fe43f72ed36 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:08.921817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e88e-8428-43e4-8a40-2fe43f72ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:08.921817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e88e-8428-43e4-8a40-2fe43f72ed36 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:08.923169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 579/1139] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:08.928647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:08.929100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:08.929211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:08.948428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:08.949638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:09.004287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:09.018140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 561/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:09.041679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736e88e-8428-43e4-8a40-2fe43f72ed36 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:09.145460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736e88e-8428-43e4-8a40-2fe43f72ed36 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:09.181017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:09.181645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:09.181961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:09.182236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:09.192347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:09.198656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:09.199722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:09.200583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 580/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:09.206128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:09.304551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b69a7-1129-4e16-8cb2-17e9c04cd2fc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:09.339895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:09.340535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:09.340815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:09.341090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:09.341832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:09.342138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:09.343511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:09.352848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 562/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:09.358839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:09.413040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:09.465563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9048b-fa3f-470e-b72d-453c5cd8120c None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:09.500098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:09.500750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:09.501035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:09.501314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] PATH_INFO: `/v3/users/50d89969237a49b983466881870dc9a1` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:09.517723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] RBAC: Authorizing `identity:get_user(user_id=50d89969237a49b983466881870dc9a1)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:09.519205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:09.520909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 581/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/users/50d89969237a49b983466881870dc9a1 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:09.527602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:09.578046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:09.627631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa9629-a5c6-44fe-a94a-02df2c4c94be None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:09.661484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:09.662135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:09.662420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:09.662697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:09.730787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:09.732275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:09.782335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:09.836288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 563/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:09.842962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:09.943773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d549c7-bbe6-4343-9567-e0ff4466cdd7 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:09.953891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:09.978442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:09.979112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:09.979402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:09.979680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] PATH_INFO: `/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:09.980882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1b49d89c4c4b2d9ffc5ce25a701854)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:09.982371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97eefc-b9a2-48c7-aecb-8d9585478343 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:09.984370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 582/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:09.990390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:10.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c168d-bf1e-46f3-b8c5-7b63291c2cca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:10.125201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:10.125844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:10.126129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:10.126404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:10.127194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ff1b49d89c4c4b2d9ffc5ce25a701854, user.id=50d89969237a49b983466881870dc9a1) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:10.127502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:10.128927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783dbbe-fa4d-45db-8e9d-416f603072f0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:10.134608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 564/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:03:09 2022] GET /identity/v3/role_assignments?user.id=50d89969237a49b983466881870dc9a1&scope.project.id=ff1b49d89c4c4b2d9ffc5ce25a701854&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:12.135876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040207c6-36ed-4582-98f9-75886fd3ac01 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.136418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040207c6-36ed-4582-98f9-75886fd3ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.136418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040207c6-36ed-4582-98f9-75886fd3ac01 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.137835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 583/1147] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:12.143266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.143694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.143818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.162225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:12.163414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:12.173420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:12.232458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 565/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:03:12.255306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040207c6-36ed-4582-98f9-75886fd3ac01 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:12.358710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040207c6-36ed-4582-98f9-75886fd3ac01 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:12.393276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:12.393857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.394138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.394412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.404704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:12.409535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:12.410665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:12.411734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 584/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:12.417111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:12.517337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d171fb7-e554-4691-95d0-971de82b903e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:12.551548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:12.552171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.552456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.552731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.553451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:12.553787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:12.555782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:12.564284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 566/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:12.570178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:12.605469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:12.669939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9b6fc-e83d-4443-9616-c428ddbcb781 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:12.703531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:12.704166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.704446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.704720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] PATH_INFO: `/v3/users/50d89969237a49b983466881870dc9a1` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.705912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] RBAC: Authorizing `identity:get_user(user_id=50d89969237a49b983466881870dc9a1)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:12.707343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:12.708933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 585/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:12 2022] GET /identity/v3/users/50d89969237a49b983466881870dc9a1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:12.717341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:12.728113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:12.821234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d35de-3c01-4745-8afa-5f60e6eda449 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:12.856540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:12.857191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:12.857476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:12.857774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] PATH_INFO: `/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:12.858934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1b49d89c4c4b2d9ffc5ce25a701854)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:12.860366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8d6b6-e491-495c-8790-05db650c83e6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:12.862079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 567/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:12 2022] GET /identity/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:12.868632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:12.972654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dddc4-5b19-41fd-9e9d-eff782b026f2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:12.974898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:13.007967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:13.009150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:13.009508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:13.010069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] PATH_INFO: `/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854/users/50d89969237a49b983466881870dc9a1/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:13.012099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] RBAC: Authorizing `identity:create_grant(project_id=ff1b49d89c4c4b2d9ffc5ce25a701854, user_id=50d89969237a49b983466881870dc9a1, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:13.013544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1760ee-7947-4293-9298-ecb61d07acdf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:13.097312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 586/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:03:12 2022] PUT /identity/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854/users/50d89969237a49b983466881870dc9a1/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:03:15.097006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329513d-b91a-455c-86dc-c2cb9f3e702c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.097534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329513d-b91a-455c-86dc-c2cb9f3e702c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.097645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329513d-b91a-455c-86dc-c2cb9f3e702c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.098940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 568/1154] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:15.104975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.105477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.105571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.124040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:15.126888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:15.194152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 587/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:15.218670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329513d-b91a-455c-86dc-c2cb9f3e702c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:15.297190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:15.325610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329513d-b91a-455c-86dc-c2cb9f3e702c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:15.360824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:15.361391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.361676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.361981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.372934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:15.377879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:15.378976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:03:15.379876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 569/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:15.385627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:15.485894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:15.492395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612a2e-2f20-418c-a5b3-39717ac83c4d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:15.527361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:15.527991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.528271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.528548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.529271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:15.529570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:15.530970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:15.539814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 588/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:15.546555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:15.649575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2351c1-2d49-403b-b0be-6fd68098d15f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:15.682555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:15.683202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.683482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.683758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] PATH_INFO: `/v3/users/50d89969237a49b983466881870dc9a1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.684922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] RBAC: Authorizing `identity:get_user(user_id=50d89969237a49b983466881870dc9a1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:15.686381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:15.687993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 570/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:15 2022] GET /identity/v3/users/50d89969237a49b983466881870dc9a1 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:15.693839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:15.799660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbb603-cc86-4950-898e-65e0c8a51132 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:15.833887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:15.834510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:15.834796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:15.835074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:15.861131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:15.905977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:15.907348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:16.004773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 589/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:16.012260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:16.016095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:16.116914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b11447-3876-48e9-ab3b-105ef0274c12 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:16.151443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:16.152088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:16.152370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:16.152647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] PATH_INFO: `/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:16.153826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1b49d89c4c4b2d9ffc5ce25a701854)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:16.155246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b65cb4-1b7d-4ca8-91c1-7fc0635bcce2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:16.156972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 571/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:16 2022] GET /identity/v3/projects/ff1b49d89c4c4b2d9ffc5ce25a701854 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:16.163072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:16.219609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:16.264038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3e49f-a0e4-4da9-a746-3d6b3c0b6872 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:16.297347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:16.297989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:16.298270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:16.298542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:16.299331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=ff1b49d89c4c4b2d9ffc5ce25a701854, user.id=50d89969237a49b983466881870dc9a1) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:16.299641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:16.301066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe4ef7-80f6-4b42-97e9-ebd6be6150ed None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:16.307601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 590/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:03:16 2022] GET /identity/v3/role_assignments?user.id=50d89969237a49b983466881870dc9a1&scope.project.id=ff1b49d89c4c4b2d9ffc5ce25a701854&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:18.381770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631477d-fa92-4ffc-9b46-55c83722ca95 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:18.382363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631477d-fa92-4ffc-9b46-55c83722ca95 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:18.382363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631477d-fa92-4ffc-9b46-55c83722ca95 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:18.383674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 572/1162] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:18.389336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:18.389804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:18.389934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:18.408528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:18.409727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:18.476970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 591/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:18.499047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631477d-fa92-4ffc-9b46-55c83722ca95 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:18.572433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:18.604070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631477d-fa92-4ffc-9b46-55c83722ca95 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:18.638668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:18.639209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:18.639494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:18.639770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:18.707389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:18.708838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:18.779150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:18.812759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 573/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:18.818248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:18.870376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:18.921549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29ce7-3678-4da6-b9a8-cd028fb681af None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:18.955471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:18.956109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:18.956389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:18.956659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:18.963495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:18.964928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-32b4b38c-7a89-4d1c-8a4f-03976e7fce8f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:18.976265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:18.977662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:18.978646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 592/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:03:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:18.983784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:19.084435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e39d-86b7-4430-965b-3a6d0f7e865d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:19.118431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:19.119052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:19.119333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:19.119608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:19.120301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:19.120604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:19.121987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd044b5-9588-427e-98c2-b1c02a74a11d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:19.129269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 574/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Aug 1 14:03:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:21.151106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2f30-c5ff-46c6-9582-ab65e1807dbe None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:21.151698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2f30-c5ff-46c6-9582-ab65e1807dbe None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:21.151698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2f30-c5ff-46c6-9582-ab65e1807dbe None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:21.153007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 593/1167] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:03:21.158392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d10ffc-57eb-4100-b1ed-fe8c76edf89a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:21.158848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d10ffc-57eb-4100-b1ed-fe8c76edf89a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:21.158953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d10ffc-57eb-4100-b1ed-fe8c76edf89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:21.177958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-17d10ffc-57eb-4100-b1ed-fe8c76edf89a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:21.179149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-17d10ffc-57eb-4100-b1ed-fe8c76edf89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:21.206538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:21.251289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 575/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:21.274580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2f30-c5ff-46c6-9582-ab65e1807dbe None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:21.381866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2f30-c5ff-46c6-9582-ab65e1807dbe None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:21.392613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:21.418471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:21.419019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:21.419303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:21.419576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:21.420282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:21.421651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8294a-0e60-4509-8a6a-256d170c49c1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:21.516020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 594/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon Aug 1 14:03:21 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:03:23.607028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23fd15-3967-4580-b152-b203b4f05c30 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:23.607617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23fd15-3967-4580-b152-b203b4f05c30 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:23.607617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23fd15-3967-4580-b152-b203b4f05c30 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:23.608936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 576/1170] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:23.614292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:23.614712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:23.614846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:23.637816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:23.639004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:23.712870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 595/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:23.737387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23fd15-3967-4580-b152-b203b4f05c30 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:23.845049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23fd15-3967-4580-b152-b203b4f05c30 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:23.880442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:23.881031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:23.881315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:23.881592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] PATH_INFO: `/v3/domains/5e48ae0cebd84a87ba350a92ad02ebd4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:23.892811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e48ae0cebd84a87ba350a92ad02ebd4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:23.894291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ae023-91ab-43d2-bf08-f31f8ba3b249 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:23.895959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 577/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Aug 1 14:03:23 2022] GET /identity/v3/domains/5e48ae0cebd84a87ba350a92ad02ebd4 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:23.902343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:24.001410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:24.004269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801331e-3bf3-40b4-bb49-ccf545583fc8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:24.039072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:24.040254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:24.040745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:24.041024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:24.041713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:24.043190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354bbe5-23d0-4775-b204-3068f37c865c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:24.146833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 596/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:03:23 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:03:26.208098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316bc3d-3c0e-44f2-8a62-886de452b5fc None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:26.208680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316bc3d-3c0e-44f2-8a62-886de452b5fc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:26.208680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316bc3d-3c0e-44f2-8a62-886de452b5fc None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:26.210008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 578/1174] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:26.216500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:26.216979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:26.217178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:26.238623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:26.239833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:26.309769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 597/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:26.334917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316bc3d-3c0e-44f2-8a62-886de452b5fc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:26.361720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:26.440769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316bc3d-3c0e-44f2-8a62-886de452b5fc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:26.475508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:26.476076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:26.476357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:26.476652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] PATH_INFO: `/v3/domains/5e48ae0cebd84a87ba350a92ad02ebd4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:26.478479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e48ae0cebd84a87ba350a92ad02ebd4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:26.479914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156ff13-a585-42d6-b191-907985d0c299 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:26.481510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 579/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Aug 1 14:03:26 2022] GET /identity/v3/domains/5e48ae0cebd84a87ba350a92ad02ebd4 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:26.487475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:26.569632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:26.588081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cce7e-16f0-4d0d-a2db-14c02657d236 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:26.622820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:26.623550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:26.623727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:26.624003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:26.624705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:26.626171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc452c-0e13-4b9a-9ca7-5d083d12485e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:26.711160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 598/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:03:26 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:03:28.793832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae67-4532-4c44-8d8b-91adad8c2c0c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:28.794375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae67-4532-4c44-8d8b-91adad8c2c0c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:28.794375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae67-4532-4c44-8d8b-91adad8c2c0c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:28.795746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 580/1178] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:28.801108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:28.801567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:28.801669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:28.819603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:28.820839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:28.890338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 599/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:28.915192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ae67-4532-4c44-8d8b-91adad8c2c0c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.014590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:29.024710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ae67-4532-4c44-8d8b-91adad8c2c0c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:29.058693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:29.059345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:29.059626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:29.059902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:29.070255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:29.075668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:29.076843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:03:29.077809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 581/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:29.082973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.149961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:29.183884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee489-93e9-4c65-be8c-e1b29142e62b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:29.221205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:29.221885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:29.222162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:29.222437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:29.223156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:29.223462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:29.224825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:29.233313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 600/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:29.239309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.352269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596009b-3e99-43cc-bd9c-eb43309c1e37 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:29.389457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:29.390129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:29.390412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:29.390692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] PATH_INFO: `/v3/users/43f34621964e4a4ba8e0b3b51fddee76` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:29.405152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] RBAC: Authorizing `identity:get_user(user_id=43f34621964e4a4ba8e0b3b51fddee76)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:29.406689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:29.408411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 582/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:29 2022] GET /identity/v3/users/43f34621964e4a4ba8e0b3b51fddee76 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:29.414453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.515714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c7e6-b40a-4bde-9d63-419ac9d1f7a2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:29.543175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:29.548682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:29.549310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:29.549594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:29.549901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:29.621170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:29.622551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:29.721668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 601/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:29.728186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.740336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:29.831382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132b2b-aee8-4cb1-8da4-3ada02a7f87b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:29.865986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:29.866632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:29.866916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:29.867215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] PATH_INFO: `/v3/projects/f9f7cb5d06f145799cb6186597e993ab` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:29.869212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] RBAC: Authorizing `identity:get_project(project_id=f9f7cb5d06f145799cb6186597e993ab)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:29.870671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4ea8-7b7a-4b16-a1ba-e89c1c8c787a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:29.872439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 583/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:29 2022] GET /identity/v3/projects/f9f7cb5d06f145799cb6186597e993ab => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:29.878591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:29.909196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:29.982118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b1cd-c991-4665-8f76-6d87d6468604 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:30.017971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:30.018582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:30.018864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:30.019135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:30.019918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=f9f7cb5d06f145799cb6186597e993ab, user.id=43f34621964e4a4ba8e0b3b51fddee76) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:30.020222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:30.021643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd89f4-af8d-4533-bc05-babbf2211b74 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:30.027708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 602/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:03:29 2022] GET /identity/v3/role_assignments?user.id=43f34621964e4a4ba8e0b3b51fddee76&scope.project.id=f9f7cb5d06f145799cb6186597e993ab&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:32.009251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f50a-f173-4f9e-a257-d8f49a120393 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.009841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f50a-f173-4f9e-a257-d8f49a120393 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.009841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033f50a-f173-4f9e-a257-d8f49a120393 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.011165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 584/1186] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:32.016556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.017024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.017024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.036751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:32.037989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:32.106382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 603/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:32.128493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033f50a-f173-4f9e-a257-d8f49a120393 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:32.214727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:32.238302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033f50a-f173-4f9e-a257-d8f49a120393 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:32.274363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:32.274906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.275190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.275466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.285525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:32.290682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:32.291814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:03:32.292891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 585/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:32.297908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:32.323406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:32.401435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d610108-3e07-4c7a-a33d-64dc846747b2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:32.435702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:32.436325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.436612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.436890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.437614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:32.437951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:32.439323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:32.448303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 604/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:32.454412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:32.554140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6f8a-b357-4070-b37f-935c7b293d72 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:32.590003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:32.590652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.590932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.591204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] PATH_INFO: `/v3/users/43f34621964e4a4ba8e0b3b51fddee76` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.592357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] RBAC: Authorizing `identity:get_user(user_id=43f34621964e4a4ba8e0b3b51fddee76)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:32.593809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:32.595404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 586/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:32 2022] GET /identity/v3/users/43f34621964e4a4ba8e0b3b51fddee76 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:32.601313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:32.688380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:32.704503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452dadb-e9df-4b0d-9fc9-a4107c00b03e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:32.738970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cb60-189f-461b-b20d-29926206840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:32.739600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cb60-189f-461b-b20d-29926206840b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.739879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cb60-189f-461b-b20d-29926206840b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.740151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cb60-189f-461b-b20d-29926206840b None admin] PATH_INFO: `/v3/projects/f9f7cb5d06f145799cb6186597e993ab` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.741280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76cb60-189f-461b-b20d-29926206840b None admin] RBAC: Authorizing `identity:get_project(project_id=f9f7cb5d06f145799cb6186597e993ab)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:32.743803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76cb60-189f-461b-b20d-29926206840b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:32.745476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 605/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:32 2022] GET /identity/v3/projects/f9f7cb5d06f145799cb6186597e993ab => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:32.751571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:32.760687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:32.851258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139138c-9278-46ca-9bd3-b4199d64c994 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:32.886552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:32.887237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:32.887523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:32.887805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] PATH_INFO: `/v3/projects/f9f7cb5d06f145799cb6186597e993ab/users/43f34621964e4a4ba8e0b3b51fddee76/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:32.889781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f7cb5d06f145799cb6186597e993ab, user_id=43f34621964e4a4ba8e0b3b51fddee76, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:32.891230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83b54-7c5b-4c9d-a307-8da4e54af8b8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:32.983296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 587/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:03:32 2022] PUT /identity/v3/projects/f9f7cb5d06f145799cb6186597e993ab/users/43f34621964e4a4ba8e0b3b51fddee76/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:03:35.016054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb166-4678-4c47-b205-92ff8922cc86 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.016578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb166-4678-4c47-b205-92ff8922cc86 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.016578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bb166-4678-4c47-b205-92ff8922cc86 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.017902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 606/1193] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:03:35.025410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.025934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.026058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.045028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:03:35.046286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:03:35.106556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:35.113941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 588/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:03:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:03:35.138480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bb166-4678-4c47-b205-92ff8922cc86 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:35.245237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bb166-4678-4c47-b205-92ff8922cc86 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:35.280026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:35.280588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.280869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.281142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.292248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:03:35.297097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:03:35.298258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:03:35.299292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 607/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:03:35.304488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:35.406322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168836d4-b8a7-432a-ac76-fd715e803523 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:35.448048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:35.448679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.448965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.449243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.449996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:35.450301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:35.451663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:35.459991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 589/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:35.469494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:35.488856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:35.575312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c646c2-c1fc-46ae-86e2-4f2b4898d283 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:35.609517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:35.610191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.610476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.610754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] PATH_INFO: `/v3/users/43f34621964e4a4ba8e0b3b51fddee76` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.611922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] RBAC: Authorizing `identity:get_user(user_id=43f34621964e4a4ba8e0b3b51fddee76)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:35.613358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:35.615007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 608/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Aug 1 14:03:35 2022] GET /identity/v3/users/43f34621964e4a4ba8e0b3b51fddee76 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:35.621276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:35.680937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:35.722621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa32bf-52b8-423c-b100-9c4c964846a8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:35.755715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:35.756337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:35.756620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:35.756894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:35.832110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:35.833486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:35.890901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:35.933730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 590/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:03:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:03:35.939710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:36.025192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:36.043824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19f2a6-fcaa-4661-9cbe-b23084650a18 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:36.079946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:36.080585 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:36.080869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:36.081147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] PATH_INFO: `/v3/projects/f9f7cb5d06f145799cb6186597e993ab` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:36.082372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] RBAC: Authorizing `identity:get_project(project_id=f9f7cb5d06f145799cb6186597e993ab)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:36.083754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38137436-5c3b-41bb-9916-7e0a8409c41b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:36.085422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 609/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Aug 1 14:03:35 2022] GET /identity/v3/projects/f9f7cb5d06f145799cb6186597e993ab => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:36.092500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:03:36.192364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d235b-ebc3-456f-bec2-0c6741eda9bc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:03:36.226163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:03:36.227108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:03:36.227520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:03:36.227802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:03:36.228619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=f9f7cb5d06f145799cb6186597e993ab, user.id=43f34621964e4a4ba8e0b3b51fddee76) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:03:36.228930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:03:36.230387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1b0f-62a9-4210-8cce-378eb12cf5ba None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:03:36.236370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 591/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:03:36 2022] GET /identity/v3/role_assignments?user.id=43f34621964e4a4ba8e0b3b51fddee76&scope.project.id=f9f7cb5d06f145799cb6186597e993ab&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:03:46.075732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=25 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:46.233623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:49.095278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b3306-dcce-4d7d-b89e-d456a8965985 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:49.095867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b3306-dcce-4d7d-b89e-d456a8965985 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:49.095867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b3306-dcce-4d7d-b89e-d456a8965985 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:49.097187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 610/1201] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:04:49.102541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:49.104410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:49.104410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:49.120752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:04:49.121957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:04:49.189219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 592/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:04:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:04:49.214273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b3306-dcce-4d7d-b89e-d456a8965985 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:49.318930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b3306-dcce-4d7d-b89e-d456a8965985 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:49.352279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:49.352847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:49.353129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:49.353442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:49.363990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:49.365456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:04:49.380633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:49.381783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:49.383343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:04:49.383343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:04:49.383343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:49.383343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:04:49.383343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 611/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:49.388341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:49.487253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edcedc-e75e-471e-b119-66163c0a9a8b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:49.515700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:49.522579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:49.523198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:49.523480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:49.523750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:49.524429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:49.524733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:49.526328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba765-7794-41da-a62a-917641b2437f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:49.538219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 593/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:49.544072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:49.597045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:49.645115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad225e08-7680-40cf-8e62-27b2147ab0bf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:49.678648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:49.679302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:49.679693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:49.679967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:49.680649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:49.682101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d233b6d-5fc6-40db-ad85-1d499c04de65 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:49.767036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 612/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Aug 1 14:04:49 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:04:51.817476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245349d-3750-46d5-89e9-9f6dad58b70b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:51.818104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245349d-3750-46d5-89e9-9f6dad58b70b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:51.818104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245349d-3750-46d5-89e9-9f6dad58b70b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:51.819420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 594/1206] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:04:51.824624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:51.825066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:51.825175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:51.843838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:04:51.845802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:04:51.914184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 613/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:04:51.936991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245349d-3750-46d5-89e9-9f6dad58b70b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.037566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245349d-3750-46d5-89e9-9f6dad58b70b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.070689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.071330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.071615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.071892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.084322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:04:52.089143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:52.090307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:52.091355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 595/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:52.097094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.136679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:52.194176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e031338-3b71-4a00-a656-9cd7369177b6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.229094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.229715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.230024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.230300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.231013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:52.231323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:52.232684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:52.241134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 614/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:04:52.246986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.297875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:52.348361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ea0a-df52-48a2-aa5f-e1ee68beb4aa None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.380827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.381464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.381745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.382049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.394286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:52.395719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:04:52.410047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:52.411137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:52.412169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:04:52.412169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:04:52.412169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:52.412169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:52.412169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 596/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:52.417054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.513472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:52.517478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f825e-9d88-4307-8c96-7bcc2872b37b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.552686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.553234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.553519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.553821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.554513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:52.554817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:52.556186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:52.567509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 615/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:52.573190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.678207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52936dc-5ca5-417a-98e6-4320c3be7791 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.679715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:52.712960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.713741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.714055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.714328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.722616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:52.724028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:04:52.735498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:52.736750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:52.737826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 597/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:52.743399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:52.847308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134fba-d10f-457b-af7a-599ead05485a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:52.881080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:52.881694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:52.882019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:52.882298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:52.883343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:52.883652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:52.885173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:52.903249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 616/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:52.909140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.016769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fae7b3-d570-4da5-beb5-61be9259c611 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:53.051346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:53.052164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:53.052426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:53.052706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:53.083394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:53.121337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:53.122832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:53.221772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 598/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:04:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:04:53.227665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.246631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:53.329086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fff48-1b31-42f5-9171-b424d023a1a2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:53.362710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:53.363346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:53.363635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:53.363970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:53.375486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:53.377164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:04:53.393578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:53.394777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:53.401812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:04:53.401812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:04:53.401812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:53.401812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:04:53.401812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 617/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:53.402195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.464580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:53.502290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c22bc-bbc7-429f-8a1e-868aa1b7294c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:53.536750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:53.537358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:53.537636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:53.537945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:53.538623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:53.538922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:53.540321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:53.551229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 599/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:53.557139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.631067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:53.662128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15cdf5-25a3-45b1-867a-db7cc591d71d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:53.696896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:53.697552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:53.697872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:53.698144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:53.706872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:53.708881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:04:53.721139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:53.722263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:04:53.723573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 618/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:53.728083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.831921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2fb3-c672-4d19-a237-a3a247ac9453 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:53.854135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:53.865257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:53.865908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:53.866194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:53.866470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:53.867211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:53.867566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:53.868995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c76794-3e84-4095-905e-a54e0b5e4f93 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:53.881573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 600/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:53.888103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:53.989935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944b4b-59aa-41cd-9b90-5bd28e6e46e9 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:54.018979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:54.024727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:54.025357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:54.025629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:54.025939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:54.026728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=429f98d35a844c0190fcc7aca87e2e1f) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:54.027040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:54.028462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f546c-8cd5-4178-bb0e-68e35c08d010 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:54.034066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 619/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:04:53 2022] GET /identity/v3/role_assignments?user.id=429f98d35a844c0190fcc7aca87e2e1f&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:56.054706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b502-86db-451a-85b1-37ddea044fe0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.055224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b502-86db-451a-85b1-37ddea044fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.055224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b502-86db-451a-85b1-37ddea044fe0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.056538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 601/1220] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:04:56.062116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.062563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.062698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.082045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:04:56.083227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:04:56.151318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 620/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:04:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:04:56.175128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b502-86db-451a-85b1-37ddea044fe0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:56.276403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b502-86db-451a-85b1-37ddea044fe0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:56.312891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:56.313462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.313745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.314044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.324168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:04:56.329668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:56.330853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:56.331915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 602/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:56.336934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:56.435739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd838-6cb0-4715-80dc-56be6de51c91 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:56.459585 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:56.470525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:56.471132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.471411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.471683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.472385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:56.472683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:56.474108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:56.481614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 621/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:04:56.487629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:56.543566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:56.598927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc32152-1cc3-4c8a-a586-8c08838f67d9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:56.632232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:56.633123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.633437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.633994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.645319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:56.646774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:04:56.661301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:56.662418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:56.663522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:04:56.663522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:04:56.663522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:56.663522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:56.663522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 603/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:56.668469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:56.772106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367fb0a-2af8-4714-82c0-798e1b0779b2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:56.806535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:56.807153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.807438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.807714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.808403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:56.808706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:56.810101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:56.821656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 622/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:56.828570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:56.926522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:56.932969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96a2e-a348-4a46-886a-9126e2e0a589 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:56.967206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:56.968186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:56.969092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:56.969366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:56.977299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:56.978787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:04:56.990495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:56.996132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:56.997350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 604/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:56.998051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.045077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:57.098272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da831c-a183-4ddc-a12d-8583d3f3d832 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.141229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.141877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.142179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.142424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.143211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:57.143515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.144929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:57.162454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 623/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:04:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:57.168444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.272042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae7f32-278f-40d4-a9fa-072b687aa040 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.306110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.306751 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.307037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.307313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.317920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.319290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:04:57.333652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:57.334812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:57.335920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:04:57.335920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:04:57.335920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:04:57.335920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:57.335920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 605/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:57.340766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.440613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc162667-c759-4665-b5fa-bf6c2d001219 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.442913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:57.474464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.475209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.475495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.475772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.476466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:57.476804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.478316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:57.490867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 624/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:57.496669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.507589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:57.599231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e1a5-0bc5-4184-a56d-86f94edc5cef None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.633136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.633865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.634148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.634422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.641644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.644228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:04:57.654177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:04:57.655959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:04:57.657051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 606/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:04:57.661958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.759970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7376c3-0c0f-4981-a265-935c62588f1e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.795904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.799011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.799011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.799011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.799011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:04:57.799011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.799780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4052f58-7687-4f35-a8ba-b693084a697c None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:57.811665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 625/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:04:57.817785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:04:57.885216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:04:57.920247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a516-306a-45a5-9ceb-77ad8fb8bdad None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:04:57.953223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:04:57.953914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:04:57.954200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:04:57.954479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/429f98d35a844c0190fcc7aca87e2e1f/roles/145c8a4465644e10a443e31d508cc5e2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:04:57.968821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=429f98d35a844c0190fcc7aca87e2e1f, role_id=145c8a4465644e10a443e31d508cc5e2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:04:57.970298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3d523-42f2-4e11-8c6c-1052a9d88b66 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:04:58.107080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 607/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:04:57 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/429f98d35a844c0190fcc7aca87e2e1f/roles/145c8a4465644e10a443e31d508cc5e2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:05:00.096709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231425-33b4-47d6-8ca5-9c98d88a897c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.097232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231425-33b4-47d6-8ca5-9c98d88a897c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.097327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231425-33b4-47d6-8ca5-9c98d88a897c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.098718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 626/1233] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:00.103985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.104421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.104531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.122888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:00.124564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:00.194044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 608/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:00.217545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231425-33b4-47d6-8ca5-9c98d88a897c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:00.243402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:00.319441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231425-33b4-47d6-8ca5-9c98d88a897c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:00.353662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:00.354242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.354522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.354792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.365028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:05:00.370026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:00.371175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:00.372010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 627/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Aug 1 14:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:00.378303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:00.423767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:00.474860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2cd2c-fe58-48b9-bdf8-b97ff53770bc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:00.509099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:00.509703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.510021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.510304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.511034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:00.511336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:00.512739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:00.522030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 609/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Aug 1 14:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:00.527564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:00.613626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:00.628630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bae38-b990-4b1b-8dc8-d8c35b5b366a None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:00.662335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:00.662970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.663250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.663520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.673452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:00.675226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:00.690088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:00.691153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:00.692478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:00.692478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:00.692478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:00.692478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:00.692478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 628/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:00.697003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:00.797541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3915a-8b8b-4fd4-99d3-6979df8eb630 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:00.806368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:00.830653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:00.831263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.831545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.831820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.832496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:00.832799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:00.834187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:00.846260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 610/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:00.851953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:00.956205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada6c-bd85-4541-807c-c926c905c745 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:00.990661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:00.991298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:00.991580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:00.991854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:00.994715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:00.999769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.001823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:05:01.013519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:01.014665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:01.015754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 629/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:01.021448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:01.122033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620faa9b-4ede-4fa8-b67b-85638c3c3328 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:01.155668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0979c-b685-4669-a017-eba34250601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:01.156280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0979c-b685-4669-a017-eba34250601c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:01.156566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0979c-b685-4669-a017-eba34250601c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:01.157335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0979c-b685-4669-a017-eba34250601c None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:01.158153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0979c-b685-4669-a017-eba34250601c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:01.158466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0979c-b685-4669-a017-eba34250601c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.159892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0979c-b685-4669-a017-eba34250601c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.177976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 611/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:01.184008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:01.285709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20393-8a89-4aff-ba86-c2ddf37812f5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:01.320089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:01.320700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:01.320982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:01.321256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:01.382015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:01.388662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.390177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.488867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 630/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:05:01.494927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0979c-b685-4669-a017-eba34250601c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:01.522739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:01.591721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0979c-b685-4669-a017-eba34250601c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:01.628370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:01.629013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:01.629294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:01.629568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:01.640011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.642387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:01.656512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:01.658284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:01.659622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:01.659622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:01.659622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:01.659622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:01.659622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 612/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:05:01.664242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:01.758058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:01.764182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087899-8a49-4fe8-8cc7-c4615af8d95b None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:01.798518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:01.799131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:01.799416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:01.799696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:01.800383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:01.800688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.802140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.814377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 631/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:01.820125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:01.901121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:01.922139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08c0de-8da8-4db6-91c7-de9c2bc71b2a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:01.957261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:01.957934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:01.958219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:01.958493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:01.965393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:01.966899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:05:01.978260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:01.979393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:01.980636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 613/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:01.985467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:02.087450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f733a2c-473c-4c5d-8c5a-c812483bb9a5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:02.122592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:02.123332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:02.123622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:02.123900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:02.124648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:02.124956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:02.127236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1d737-e09d-4b75-a951-ddc74f02fc37 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:02.139365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 632/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:02.145959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:02.246178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad2883-fd3c-42a7-8cc9-227529fcfa37 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:02.280660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:02.281298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:02.281595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:02.281917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:02.282701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] RBAC: Adding query filter params (role.id=145c8a4465644e10a443e31d508cc5e2, scope.project.id=795fb0432e984025b689745107879b62, user.id=429f98d35a844c0190fcc7aca87e2e1f) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:02.283009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:02.284478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30033a4-0e05-4b0d-a836-d5d4d4f50094 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:02.290311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 614/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:05:02 2022] GET /identity/v3/role_assignments?user.id=429f98d35a844c0190fcc7aca87e2e1f&scope.project.id=795fb0432e984025b689745107879b62&role.id=145c8a4465644e10a443e31d508cc5e2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:04.376968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f882-a691-4094-a31a-f9e474cf9ce9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:04.377536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f882-a691-4094-a31a-f9e474cf9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:04.377631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30f882-a691-4094-a31a-f9e474cf9ce9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:04.378975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 633/1247] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:04.384280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:04.384714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:04.384839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:04.391933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:04.404219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:04.405396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:04.471359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 615/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:04.494283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30f882-a691-4094-a31a-f9e474cf9ce9 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:04.513056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:04.598814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30f882-a691-4094-a31a-f9e474cf9ce9 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:04.633268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:04.633864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:04.634148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:04.634421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:04.645153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:05:04.649972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:04.651061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:04.652066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 634/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:04.658052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:04.756186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde4727-8b1e-43a5-b46c-9383e29cffc0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:04.790748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:04.795568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:04.796185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:04.796466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:04.796741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:04.798615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:04.798930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:04.800283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:04.808184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 616/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:04.814451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:04.892778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:04.915576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ac2-0ca6-4cbd-a70b-2e1989a8a95e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:04.949359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:04.950017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:04.950306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:04.950657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:04.960875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:04.962424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:04.978898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:04.979873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:04.980919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:04.980919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:04.980919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:04.980919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:04.980919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 635/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:04.986871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:05.088904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae53837-3d28-44f5-8bc2-991a4569e95d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:05.123887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:05.124506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:05.124788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:05.125062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:05.126010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:05.126190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:05.127568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:05.149297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 617/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:05:05.150430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:05.252401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ca0ce-0113-413b-bcdc-fd43b502969d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:05.277424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:05.285352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:05.286008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:05.286290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:05.286570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:05.293872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:05.295318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:05:05.307696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:05.308853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:05.310245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 636/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:05.315551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:05.371451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:05.415414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb77e5-a9c5-4639-8f9d-e479d51bd4fe None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:05.449038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:05.449650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:05.450126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:05.450400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:05.451411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:05.451792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:05.453562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:05.471514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 618/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:05:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:05.477386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:05.575994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13a52-f755-4e36-b440-61bad5d0166e None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:05.609428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:05.610682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:05.610961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:05.611242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:05.666035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:05.678671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:05.680188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:05.775737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 637/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:05:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:05:05.781511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:05.886139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce557ab-e2a4-4c3b-9d66-6ee274b6a052 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:05.900245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:05.921373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:05.922031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:05.922700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:05.922700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:05.932632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:05.934204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:05.948412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:05.949557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:05.950755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:05.950755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:05.950755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:05.950755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:05.950755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 619/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:05.956168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:06.046906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:06.060608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44282-157a-438b-9095-c6e00af5daa2 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:06.095423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:06.096047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:06.096330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:06.096603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:06.097316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:06.097672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:06.098999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:06.110537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 638/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:06.116776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:06.216964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30c9b8-87c7-49eb-8707-109c1b3e3822 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:06.252379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:06.253028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:06.253311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:06.253587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:06.260403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:06.261867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:05:06.273349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:06.274445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:06.275437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 620/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:06.280355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:06.381458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d3be1-ad7d-4a75-b7b5-897c85845705 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:06.415124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:06.415836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:06.416176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:06.416545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:06.417389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:06.417800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:06.419270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6360c-ad4b-466d-8e99-361dd88c86ce None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:06.432014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 639/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:06.438358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:06.465302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:06.541017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e801c-bc68-4e8e-b035-0540cb0aefa4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:06.573667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:06.574314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:06.574602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:06.574882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:06.575667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=429f98d35a844c0190fcc7aca87e2e1f) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:06.575982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:06.577429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d0109-bfa5-46d6-9cba-03cd78d32ff1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:06.584092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 621/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:05:06 2022] GET /identity/v3/role_assignments?user.id=429f98d35a844c0190fcc7aca87e2e1f&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:08.567071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb698-7798-4adb-ac39-6eb722b6acab None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:08.567606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb698-7798-4adb-ac39-6eb722b6acab None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:08.567725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb698-7798-4adb-ac39-6eb722b6acab None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:08.569103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 640/1261] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:08.574824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:08.575210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:08.575385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:08.594439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:08.595618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:08.664419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 622/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:08.687850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb698-7798-4adb-ac39-6eb722b6acab None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:08.699896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:08.791002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb698-7798-4adb-ac39-6eb722b6acab None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:08.826666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:08.827226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:08.827505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:08.827773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:08.837779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:05:08.842618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:08.843747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:08.845561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 641/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:08.850702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:08.870042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:08.952023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f2001-e124-4e14-a974-754abbf9c0c0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:08.987084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:08.987701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:08.987983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:08.988256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:08.988963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:08.989265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:08.990746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:08.998554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 623/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:09.006817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.074685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:09.107984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1a043-59ba-411a-a61f-aa8274fc80be None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.141633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.142358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.142671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.143053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.155064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.157173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:09.171751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:09.172892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:09.174248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:09.174248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:09.174248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:09.174248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:09.174248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 642/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:09.178971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.262100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:09.281409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184cd61-074b-4ad7-9379-a5058a791e83 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.315253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.315871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.316155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.316440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.317123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:09.317430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.318920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.331221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 624/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:09.337232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.436046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faeecb-757a-458d-8e38-1fa2fdc4d3cf None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.456925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:09.470488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.471126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.471409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.471684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.479342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.480776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:05:09.492188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:09.493296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:09.494648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 643/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:09.499228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.603033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb46b7-0102-4200-bec1-e46013b4ef11 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.637889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.638503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.638786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.639093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.639880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:09.640189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.641635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.650123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:09.658212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 625/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:09.664016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.766561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd822a-8ccf-45ab-83fe-33bb3da1d549 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.800565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.801203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.801486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.801780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.812367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.814582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:09.830660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:09.836713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:09.837654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:09.837654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:09.837654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:09.837654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:09.837654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 644/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:09.837988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:09.939546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d855-5767-446e-b728-ada3e9d58a27 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:09.973031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:09.973650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:09.973965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:09.974244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:09.974924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:09.975230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:09.976594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:09.988784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 626/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:09.994699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:10.030208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:10.100869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432d9a-685a-4aa8-935e-9c8b4a8093b0 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:10.137219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:10.137882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:10.138165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:10.138502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:10.148294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:10.149728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:05:10.161030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:10.162110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:10.163382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 645/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:10.168110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:10.227642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:10.269401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d364-37d2-420b-9851-b92d0276a335 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:10.303040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:10.303620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:10.304133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:10.305024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:10.305866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:10.306182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:10.307632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4748-2c53-4fe7-8dfb-6a147ef76060 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:10.320117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 627/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:10.326231 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:10.418781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:10.427576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f7af-03b9-4ce8-b922-1c8a2150c072 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:10.463591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:10.464281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:10.464566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:10.464842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] PATH_INFO: `/v3/projects/795fb0432e984025b689745107879b62/users/429f98d35a844c0190fcc7aca87e2e1f/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:10.467058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=795fb0432e984025b689745107879b62, user_id=429f98d35a844c0190fcc7aca87e2e1f, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:10.468607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a7085-c0b6-4caf-810c-80af9df068f0 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:10.617260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 646/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Aug 1 14:05:10 2022] PUT /identity/v3/projects/795fb0432e984025b689745107879b62/users/429f98d35a844c0190fcc7aca87e2e1f/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:05:12.645567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddda77-ac81-488c-82fd-aca05cba6b38 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:12.646124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddda77-ac81-488c-82fd-aca05cba6b38 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:12.646246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddda77-ac81-488c-82fd-aca05cba6b38 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:12.647502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 628/1274] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:05:12.652905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:12.653432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:12.653539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:12.672658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:12.673936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:12.744658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 647/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:05:12.769631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddda77-ac81-488c-82fd-aca05cba6b38 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:12.871926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddda77-ac81-488c-82fd-aca05cba6b38 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:12.889256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:12.905764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:12.906369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:12.907269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:12.907548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:12.919498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:05:12.927118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:12.928597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:12.929464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 629/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Aug 1 14:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:12.935029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.024647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:13.042265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7f94-2686-4f15-a5fa-72ab0bb8e262 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.080309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.080976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.081253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.081530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:13.082288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:13.082597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:13.083964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:13.092283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 648/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Aug 1 14:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:13.098691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.218727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24f79e-a03d-42ae-9552-9aacf40e6aad None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.253413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.254197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.254525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.254850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:13.268342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:13.270086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:13.287098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:13.292383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:13.293504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:13.293504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:13.293504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:13.293504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:13.293504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 630/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:13.294281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.395705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3364e-6e06-482b-ab7e-0aa2459d7fee None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.428917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.429531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.429844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.430123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:13.430808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:13.431112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:13.432471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:13.444901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 649/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:13.450735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.484933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:13.554760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042eb1a5-1c77-42b1-84ba-db4ed693850d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.593202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.593972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.594914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.598160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:13.603555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:13.605135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:05:13.617205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:13.618731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:13.620386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 631/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:13.624781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.633678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:13.729534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76d7e8-6558-43c7-b7ee-30bccab69221 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.763248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.763878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.764161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.764440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:13.765401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:13.765712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:13.768066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:13.786973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 650/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Aug 1 14:05:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:13.793042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:13.894748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:13.904252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e386a3-46b2-4dfc-bb79-630573a3fa47 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:13.937512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:13.938794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:13.939083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:13.939363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.009854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.011369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.103860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:14.114619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 632/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Aug 1 14:05:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:05:14.120492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:14.182121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:14.222801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559a1da-c87e-4049-af17-c2c53ab96a7d None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:14.259571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:14.260208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:14.260485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:14.260757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.270886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.272448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:05:14.287985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:14.289041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:14.290048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:05:14.290048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:05:14.290048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:05:14.290048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:14.290048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 651/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:14.295194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:14.398615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbcb46-4e15-47b2-9a95-7e93e0bd2afe None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:14.432541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:14.433152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:14.433437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:14.433715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.434432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:14.434732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.436085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.448074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 633/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Aug 1 14:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:14.454474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:14.555194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac40cb-f759-4faf-b943-52ba369058f5 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:14.568894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:14.589991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:14.590864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:14.591497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:14.591780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.600228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.601546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:05:14.614403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:14.615429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: ERROR keystone.server.flask.application Aug 01 14:05:14.616961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 652/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Aug 1 14:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:14.621456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:14.673520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:14.726164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba410f50-f534-4a79-9970-a61143352c7e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:14.760342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:14.761018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:14.761230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:14.761508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.762801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:14.762801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.764083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a4cc-4b91-4dec-bccf-3ed3ebb58ff8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.777124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 634/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Aug 1 14:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:14.784406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:14.887678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff22d-1342-4984-8347-2c9c2027ed8f None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:14.923064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:14.923733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:14.923966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:14.924281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:14.925029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] RBAC: Adding query filter params (role.id=1c201ebfc669434982f999e02a45c09f, scope.project.id=795fb0432e984025b689745107879b62, user.id=429f98d35a844c0190fcc7aca87e2e1f) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:14.925339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:14.926803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d95416-b0f2-419f-9d27-36e8c6abba64 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:14.932595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 653/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Aug 1 14:05:14 2022] GET /identity/v3/role_assignments?user.id=429f98d35a844c0190fcc7aca87e2e1f&scope.project.id=795fb0432e984025b689745107879b62&role.id=1c201ebfc669434982f999e02a45c09f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:16.964489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171f88-418a-45fc-bf78-c35a2b3b91a0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:16.965399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171f88-418a-45fc-bf78-c35a2b3b91a0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:16.965399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171f88-418a-45fc-bf78-c35a2b3b91a0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:16.967132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 635/1288] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:16.974283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:16.974716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:16.974836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:16.994960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:16.996456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:17.038831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:17.088407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 654/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:17.111863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9171f88-418a-45fc-bf78-c35a2b3b91a0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:17.228521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9171f88-418a-45fc-bf78-c35a2b3b91a0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:17.241740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:17.267839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:17.268495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:17.269342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:17.269342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:17.269685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:17.271198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:17.281326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:17.282549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:17.283808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 636/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:05:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:17.289779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:17.400100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf22c3-c0fd-42da-80a4-ec25a4a95d96 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:17.436883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:17.437517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:17.438494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:17.438877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:17.439574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:17.439886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:17.441260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94984d7e-b9a5-4dbe-83c4-c810f8e4293e None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:17.446570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 655/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Aug 1 14:05:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:17.452579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:17.562839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e4bd7-60aa-497a-a0fa-216d9e21d715 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:17.596037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:17.596650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:17.596931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:17.597206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:17.597934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:17.598238 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:17.599684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc0b5e-8264-4355-a536-5bf35e5f078d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:17.604103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 637/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Aug 1 14:05:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:19.646073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312af099-377c-4857-88cf-47c1d757d893 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:19.646746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312af099-377c-4857-88cf-47c1d757d893 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:19.646746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312af099-377c-4857-88cf-47c1d757d893 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:19.647989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 656/1293] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:19.653407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310764b-dbd9-451d-87e0-0fa2295072c7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:19.653874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310764b-dbd9-451d-87e0-0fa2295072c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:19.653979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310764b-dbd9-451d-87e0-0fa2295072c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:19.672253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f310764b-dbd9-451d-87e0-0fa2295072c7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:19.673459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f310764b-dbd9-451d-87e0-0fa2295072c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:19.701914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:19.738845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 638/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:19.761647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312af099-377c-4857-88cf-47c1d757d893 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:19.795958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:19.868226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312af099-377c-4857-88cf-47c1d757d893 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:19.909684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:19.910257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:19.910538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:19.910811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:19.911498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:19.912888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0d4af-c2b2-40eb-a014-3b19038a85a1 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:20.024576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 657/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Aug 1 14:05:19 2022] POST /identity/v3/services => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:05:22.099865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8fa33-3f86-402b-b542-cccbdd92375c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.100449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8fa33-3f86-402b-b542-cccbdd92375c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.100449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8fa33-3f86-402b-b542-cccbdd92375c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.102110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 639/1296] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:22.107710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.108122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.108359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.128392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:22.129570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:22.204910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 658/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:22.227790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8fa33-3f86-402b-b542-cccbdd92375c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:22.331990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8fa33-3f86-402b-b542-cccbdd92375c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:22.369111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:22.369111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.369111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.369111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.369726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:22.371243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:22.380934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:22.382254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:22.383511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 640/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:05:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:22.388771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:22.407045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:22.488247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb20f13-1446-427d-8a98-d46cc12a5c7e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:22.523230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:22.523940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.524329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.524685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.525500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:22.525823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:22.527329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:22.532722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 659/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Aug 1 14:05:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:22.539647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:22.575425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:22.647338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f041a9-ca58-4268-b22d-23a65dc07b5a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:22.681462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] RBAC: Adding query filter params (interface=public, service_id=8ebc16c660804a1a9549f1cfa36928f3, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:22.688359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f7540-c3a8-49ca-b368-d1ff87d62280 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:22.691079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 641/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Aug 1 14:05:22 2022] GET /identity/v3/endpoints?service_id=8ebc16c660804a1a9549f1cfa36928f3&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:22.696986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:22.783087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:22.801264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c946b-073b-414d-a907-281b5da5e234 None admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:22.835472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:22.836104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:22.836373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:22.836654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:22.837308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:22.838702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534252-3eca-477c-9a63-b3b812affa10 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:22.846158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 660/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Aug 1 14:05:22 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:05:24.852212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23482-25cb-4092-8af1-2bef4d923444 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:24.852800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23482-25cb-4092-8af1-2bef4d923444 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:24.852800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23482-25cb-4092-8af1-2bef4d923444 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:24.854190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 642/1302] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:05:24.860041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:24.860572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:24.860953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:24.879402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:05:24.880597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:05:24.946921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 661/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:05:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:05:24.970441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23482-25cb-4092-8af1-2bef4d923444 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:25.067005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:25.074094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23482-25cb-4092-8af1-2bef4d923444 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:25.108380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:25.109009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:25.109445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:25.110053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:25.110614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:25.111971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:05:25.120869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:05:25.122106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Aug 01 14:05:25.123231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 643/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Aug 1 14:05:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:05:25.129131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:25.208820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:25.231396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27525220-86f6-4306-a8b9-fbfe8677bd5b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:25.266197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:25.266950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:25.267240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:25.267511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] PATH_INFO: `/v3/services` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:25.268184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:05:25.268489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:25.269878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166266-d0f0-4297-a58d-89d4740fd703 None admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:25.275172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 662/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Aug 1 14:05:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:05:25.281338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:05:25.384904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96323c6-dde6-48db-af40-365e51b50061 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:05:25.417533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:05:25.418181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:05:25.418465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:05:25.418743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:05:25.419447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:05:25.420795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942dea3-cf65-4c36-b20f-aadf874f4226 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:05:25.491821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 644/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:05:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:05:35.297682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=30 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:05:35.487364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:41.625548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1beaf7-88ad-443b-ae07-16466735dfc5 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:41.626894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1beaf7-88ad-443b-ae07-16466735dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:41.627417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1beaf7-88ad-443b-ae07-16466735dfc5 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:41.633457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 663/1307] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:41.635307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a057a-e4e2-4146-b024-313d80dd0598 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:41.636190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a057a-e4e2-4146-b024-313d80dd0598 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:41.636686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a057a-e4e2-4146-b024-313d80dd0598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:41.789424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-413a057a-e4e2-4146-b024-313d80dd0598 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:41.792585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-413a057a-e4e2-4146-b024-313d80dd0598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:41.943086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 645/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:41.989730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:41.990148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:41.991353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:41.993104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 664/1309] 10.222.0.49 () {54 vars in 965 bytes} [Mon Aug 1 14:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:41.999295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc01a-7b09-4fee-8716-cb1535dac3de None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:41.999737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc01a-7b09-4fee-8716-cb1535dac3de None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:42.000131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc01a-7b09-4fee-8716-cb1535dac3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:42.096667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8a4cc01a-7b09-4fee-8716-cb1535dac3de None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:42.098061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8a4cc01a-7b09-4fee-8716-cb1535dac3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:42.125459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:42.212705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 646/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Mon Aug 1 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:42.222639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:42.224799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:42.371098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3586-8c0b-4fe3-8a2f-d44bfd47a25a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:42.471347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:42.471898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:42.472180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:42.472454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:42.474181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:42.547558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:42.634266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:42.635715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a5fc8-71ef-4f90-b0b1-9cd5766fd473 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:42.655718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 665/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:11:45.024985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:45.025589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:45.025589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:45.027000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 647/1312] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:45.032673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74cf0c-73be-49ff-944f-db538e59c5c7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:45.033203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74cf0c-73be-49ff-944f-db538e59c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:45.033300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74cf0c-73be-49ff-944f-db538e59c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:45.123278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4e74cf0c-73be-49ff-944f-db538e59c5c7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:45.124518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e74cf0c-73be-49ff-944f-db538e59c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:45.229837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 666/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:45.269539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:45.271145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:45.393716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d7c82-6cc1-4680-bd04-93c8451726df None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:45.471396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:45.473968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:45.475094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:45.475854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:45.476135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:45.477781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:45.601981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:45.603460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f229c1-47b5-44fa-afd5-0343895bf88a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:45.622725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 648/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:11:48.220171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f4c9-60b3-4f63-bbaf-1f1fbccfac84 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:48.220774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f4c9-60b3-4f63-bbaf-1f1fbccfac84 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:48.220774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f4c9-60b3-4f63-bbaf-1f1fbccfac84 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:48.222322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 667/1315] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:48.228104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff874a9-fcc5-409b-9c4f-5bf17505e853 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:48.228561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff874a9-fcc5-409b-9c4f-5bf17505e853 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:48.228658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff874a9-fcc5-409b-9c4f-5bf17505e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:48.306051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4ff874a9-fcc5-409b-9c4f-5bf17505e853 None None] MFA Rules not processed for user `d073dc9750f945a8aad22251b28e5c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:48.307325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4ff874a9-fcc5-409b-9c4f-5bf17505e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:48.360397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:48.407091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 649/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:48.463817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:48.464106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:48.464383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:48.465788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 668/1317] 10.222.0.49 () {54 vars in 965 bytes} [Mon Aug 1 14:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:48.472527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8cce-1891-4b84-a496-f18ae5be184f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:48.472527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8cce-1891-4b84-a496-f18ae5be184f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:48.472527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f8cce-1891-4b84-a496-f18ae5be184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:48.568148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-646f8cce-1891-4b84-a496-f18ae5be184f None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:48.569354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-646f8cce-1891-4b84-a496-f18ae5be184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:48.649872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 650/1318] 10.222.0.49 () {58 vars in 1062 bytes} [Mon Aug 1 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:48.659252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:48.660760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:48.671836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:48.780019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c530d-0c0e-4f0d-b1bd-3625342afab5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:48.858565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:48.859181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:48.859475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:48.859725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:48.861332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:48.931128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:48.979845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:48.981281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff2a04-094c-4420-a754-acfbc84eb2d8 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:48.999747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 669/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:11:52.304369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.304913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.304913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.306314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 651/1320] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:52.311540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467caf-ec1f-442c-9aa6-fbf141eb6235 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.316380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467caf-ec1f-442c-9aa6-fbf141eb6235 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.316380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467caf-ec1f-442c-9aa6-fbf141eb6235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.379695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ff467caf-ec1f-442c-9aa6-fbf141eb6235 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:52.381597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ff467caf-ec1f-442c-9aa6-fbf141eb6235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:52.480192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 670/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:11:52.520025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:52.521828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:52.573094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:52.625704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189cd62-fe04-4b91-b12d-bc25858c33e8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:52.698499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:52.699117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.699403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.699678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.701313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:52.796772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:52.810201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:52.811640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42537cb-a827-42c2-b1c6-d938f63b5490 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:52.829381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 652/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:11:55.969377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.969960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.969960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:55.971465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 671/1323] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:55.976935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d6a32-9aaf-43b2-990e-ea22b54657a5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.977366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d6a32-9aaf-43b2-990e-ea22b54657a5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.977488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d6a32-9aaf-43b2-990e-ea22b54657a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.053161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bc7d6a32-9aaf-43b2-990e-ea22b54657a5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:56.054391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bc7d6a32-9aaf-43b2-990e-ea22b54657a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:56.150442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 653/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:11:56.187715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:56.189350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:56.211116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.300745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d5b08-eea3-4b09-9bb5-a175388be87f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.383069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.383784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.383982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.384251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.386003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:56.466833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.506405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.507836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b54e-b534-4fa2-afe2-63d11ff7995a service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:56.527081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 672/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:11:58.625966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:58.626769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:58.626769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:58.628145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 654/1326] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:58.634381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440695-5f22-4380-a5e9-14b43346069a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:58.635164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440695-5f22-4380-a5e9-14b43346069a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:58.635164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440695-5f22-4380-a5e9-14b43346069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:58.706312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0f440695-5f22-4380-a5e9-14b43346069a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:58.707570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0f440695-5f22-4380-a5e9-14b43346069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:58.819244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 673/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:11:58.860610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:58.862968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:58.937731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:58.987547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d9a75-c3be-4457-85ea-4ae4e5eb9ac1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:59.069699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:59.070273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:59.070559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:59.070838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:59.072501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:59.183409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:59.185877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:59.187321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2531c2f-f84c-440b-b1b5-9e32a7c38fe9 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:59.209844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 655/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:01.281715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.282296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.282296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.283664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 674/1329] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:01.289850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd794b-1fa9-436f-9698-563cafb5241e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.290376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd794b-1fa9-436f-9698-563cafb5241e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.290488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd794b-1fa9-436f-9698-563cafb5241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.365620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-38fd794b-1fa9-436f-9698-563cafb5241e None None] MFA Rules not processed for user `d073dc9750f945a8aad22251b28e5c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:01.366927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-38fd794b-1fa9-436f-9698-563cafb5241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:01.475226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 656/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:01.515830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.517366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:01.554033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.635245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25931bd-cb10-47af-a02e-b732466e470c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.715527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.716155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.716437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.716711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.718357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:01.805717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.842070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.846241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209756bf-c3d3-427e-b953-0e1b4bcae1ff service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.867766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 675/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:04.386873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.387473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.387473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.388817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 657/1332] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:04.394933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5fff4-1702-4a78-819a-717453819f04 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.395484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5fff4-1702-4a78-819a-717453819f04 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.395484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5fff4-1702-4a78-819a-717453819f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.465301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-07e5fff4-1702-4a78-819a-717453819f04 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:04.466617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-07e5fff4-1702-4a78-819a-717453819f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:04.566889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 676/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:04.603595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:04.605127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:04.675294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.712945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc386-da21-418c-a513-f0eb510327e9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:04.792918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:04.793546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.793861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.794137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.795778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:04.919059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:04.921763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b45304-f477-44bc-9ba1-36b27a4a5c54 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:04.931573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.938990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 658/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:07.018611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:07.019144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:07.019144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:07.020441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 677/1335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:07.026673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd62-58ff-4822-974e-88c7055320a3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:07.027159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd62-58ff-4822-974e-88c7055320a3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:07.027255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4bd62-58ff-4822-974e-88c7055320a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:07.094988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-65b4bd62-58ff-4822-974e-88c7055320a3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:07.096229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65b4bd62-58ff-4822-974e-88c7055320a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:07.200102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 659/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:07.241405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:07.242993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:07.286149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:07.356027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f5bc7-915f-4bd0-9cc3-fba4a6a09929 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:07.440352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:07.440980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:07.441259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:07.441533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:07.444100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:07.531525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:07.558421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:07.559830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a580c-2f23-46c1-93cf-c34f0ce86eb0 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:07.578823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 678/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:10.202849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.203438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.203537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.204888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 660/1338] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:10.210909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde360a-701b-4a81-b067-a37c31f5c5ad None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.211376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde360a-701b-4a81-b067-a37c31f5c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.211502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde360a-701b-4a81-b067-a37c31f5c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.289226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4cde360a-701b-4a81-b067-a37c31f5c5ad None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:10.290482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4cde360a-701b-4a81-b067-a37c31f5c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:10.387926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 679/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:10.424870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:10.426461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:10.500958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:10.528645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f11bd-e280-489c-ab40-519ee54f505e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:10.602087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:10.602707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.602993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.603270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.604875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:10.718651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:10.720075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac1c0-3460-40a5-b9e8-d8986f5ac943 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.738149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 661/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:15.216201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.216774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.216774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.218322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 680/1341] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:15.223685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd54db-7180-45d0-9e91-3c28c775ba08 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.224150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd54db-7180-45d0-9e91-3c28c775ba08 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.224289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd54db-7180-45d0-9e91-3c28c775ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.229785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.291347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-26bd54db-7180-45d0-9e91-3c28c775ba08 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:15.292571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-26bd54db-7180-45d0-9e91-3c28c775ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:15.391809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 662/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:15.430765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:15.432282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:15.483961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.539556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32ec48-9867-468e-a211-ff1586b21956 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:15.613706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:15.614348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.614695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.614971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.616672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:15.710655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.728047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:15.729485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30a91-586f-4972-9e31-56792c103959 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:15.748842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 681/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:18.845560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.846148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.846148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.847518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 663/1344] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:12:18.853327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d62a-8a31-40cf-9df3-85a4b37191d9 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.853883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d62a-8a31-40cf-9df3-85a4b37191d9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.853982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d62a-8a31-40cf-9df3-85a4b37191d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.923021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e882d62a-8a31-40cf-9df3-85a4b37191d9 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:18.924244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e882d62a-8a31-40cf-9df3-85a4b37191d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:19.027854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 682/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:19.065981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.067613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:19.160428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.178562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2737-1b2c-4ecb-9601-a0d3a3e888e2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.254560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.255197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.255485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.255762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.257386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:19.380604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.382243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed6fc2-fe09-43de-a8e1-b4c2c61e54d9 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.404557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 664/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:23.779781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:23.780326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:23.780326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:23.785947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 683/1347] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:23.788594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bcbe-408e-4aa0-9347-2098ac850b89 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:23.789058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bcbe-408e-4aa0-9347-2098ac850b89 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:23.789175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bcbe-408e-4aa0-9347-2098ac850b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:23.806016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:23.867850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4572bcbe-408e-4aa0-9347-2098ac850b89 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:23.869018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4572bcbe-408e-4aa0-9347-2098ac850b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:23.983095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 665/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:12:24.023501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:24.025030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:24.091980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.147004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c840e1-2d0f-41e0-b20c-c40670a1939b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:24.228852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:24.229482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:24.229803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:24.230066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:24.231742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:24.355632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.359657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:24.361118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7d1c8-483d-422d-8674-5bc4a5e986ad service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:24.383036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 684/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:29.503610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17653c-74aa-41a5-98b8-001a06b2db40 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.504136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17653c-74aa-41a5-98b8-001a06b2db40 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.504365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17653c-74aa-41a5-98b8-001a06b2db40 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.506867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 666/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:12:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:29.512425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503975-f8f8-4cf1-8113-9845348d6abe None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.512859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503975-f8f8-4cf1-8113-9845348d6abe None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.513061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96503975-f8f8-4cf1-8113-9845348d6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.647811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-96503975-f8f8-4cf1-8113-9845348d6abe None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:29.649649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-96503975-f8f8-4cf1-8113-9845348d6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:29.816722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 685/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:33.980985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=59 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:34.022167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3b60-16dd-417d-8017-f377337a29f2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:34.022357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3b60-16dd-417d-8017-f377337a29f2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:34.022648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3b60-16dd-417d-8017-f377337a29f2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:34.023971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 667/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:34.029406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118b1d-ad52-45e8-8539-010d2ad245bd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:34.029885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118b1d-ad52-45e8-8539-010d2ad245bd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:34.029987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118b1d-ad52-45e8-8539-010d2ad245bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:34.084229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:34.108813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8e118b1d-ad52-45e8-8539-010d2ad245bd None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:34.110236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8e118b1d-ad52-45e8-8539-010d2ad245bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:34.234215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 686/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:35.710315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cbc9-ec15-4791-b84a-84dd7f59e5e2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:35.710839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cbc9-ec15-4791-b84a-84dd7f59e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:35.710839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cbc9-ec15-4791-b84a-84dd7f59e5e2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:35.712253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 668/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:35.717519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2729-8088-4e85-bc1c-47915d5c48c7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:35.718028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2729-8088-4e85-bc1c-47915d5c48c7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:35.718109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2729-8088-4e85-bc1c-47915d5c48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:35.801247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-55ad2729-8088-4e85-bc1c-47915d5c48c7 None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:35.802600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-55ad2729-8088-4e85-bc1c-47915d5c48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:35.845931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:35.918324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 687/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:39.504379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab179-3f48-4113-a96f-5170b86152b3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:39.505576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab179-3f48-4113-a96f-5170b86152b3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:39.505576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab179-3f48-4113-a96f-5170b86152b3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:39.507250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 669/1356] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:39.513868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e683-f7af-4c5a-8f70-887eb2be4ac5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:39.514468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e683-f7af-4c5a-8f70-887eb2be4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:39.514468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e683-f7af-4c5a-8f70-887eb2be4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:39.608188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-eda5e683-f7af-4c5a-8f70-887eb2be4ac5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:39.609642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-eda5e683-f7af-4c5a-8f70-887eb2be4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:39.733942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 688/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:39.794198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:39.794495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:39.795050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:39.796730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 670/1358] 10.222.0.49 () {54 vars in 962 bytes} [Mon Aug 1 14:12:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:39.805931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307841a-abca-4c6b-8eb9-23f32b2f740e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:39.806218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307841a-abca-4c6b-8eb9-23f32b2f740e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:39.806583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307841a-abca-4c6b-8eb9-23f32b2f740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:39.824068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.897994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a307841a-abca-4c6b-8eb9-23f32b2f740e None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:39.899525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a307841a-abca-4c6b-8eb9-23f32b2f740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:40.051445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 689/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Aug 1 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:40.060430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:40.061960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:40.236215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1be8b-3f99-4d8d-acc3-842ac34dc936 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:40.319841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:40.366833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:40.367827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:40.368264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:40.368731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:40.370839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:40.484551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:40.486530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abb13f-7915-49d7-8a3b-ecabb54d9203 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:40.509464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 671/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:42.875029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:42.875851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:42.875851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:42.877411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 690/1361] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:42.884078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3df9-2cd3-4d23-a09c-dafbc84a80de None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:42.884611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3df9-2cd3-4d23-a09c-dafbc84a80de None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:42.884611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3df9-2cd3-4d23-a09c-dafbc84a80de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:42.960843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d6db3df9-2cd3-4d23-a09c-dafbc84a80de None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:42.962069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d6db3df9-2cd3-4d23-a09c-dafbc84a80de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:43.004314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.072976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 672/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:43.123843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:43.127580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:43.215079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.343095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338f7a-698c-4870-9def-fb69262aea5e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:43.491072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:43.491702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:43.491986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:43.492266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:43.493968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:43.519223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:43.602120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:43.603734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd22f3-6a4b-46ba-88f3-a39ab59309bc service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:43.624569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 691/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:46.204525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241efff-6919-4194-81f9-1c621e5d94b8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:46.205441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241efff-6919-4194-81f9-1c621e5d94b8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:46.205916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241efff-6919-4194-81f9-1c621e5d94b8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:46.207455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 673/1364] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:46.213547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e01-532b-4a6e-a77a-f78f382877dc None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:46.214074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e01-532b-4a6e-a77a-f78f382877dc None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:46.214156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491e01-532b-4a6e-a77a-f78f382877dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:46.296640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4e491e01-532b-4a6e-a77a-f78f382877dc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:46.298335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e491e01-532b-4a6e-a77a-f78f382877dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:46.414777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:46.421805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 692/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:46.466952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:46.467531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:46.468048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:46.469705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 674/1366] 10.222.0.49 () {54 vars in 962 bytes} [Mon Aug 1 14:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:46.477045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96202-d74f-414c-855c-729a7ea0bbc4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:46.477477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96202-d74f-414c-855c-729a7ea0bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:46.478055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e96202-d74f-414c-855c-729a7ea0bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:46.573413 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-61e96202-d74f-414c-855c-729a7ea0bbc4 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:46.574872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-61e96202-d74f-414c-855c-729a7ea0bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:46.729640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 693/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Aug 1 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:46.737849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:46.740274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:46.937437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973fb0-c0d3-4435-855a-be80aa1a21f6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:46.965452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:47.090489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:47.091111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:47.091403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:47.091664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:47.093307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:47.217125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:47.218785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c815-644e-41d7-b43a-650562b9e5dc service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:47.238588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 675/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:48.055532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f65f5-c7a6-4f21-ae3f-f08a61f6cb8c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:48.056048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f65f5-c7a6-4f21-ae3f-f08a61f6cb8c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:48.056048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f65f5-c7a6-4f21-ae3f-f08a61f6cb8c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:48.057786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 694/1369] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:48.063240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2b5-58aa-485d-bb56-accf3ea1d1a5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:48.063589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2b5-58aa-485d-bb56-accf3ea1d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:48.063940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2b5-58aa-485d-bb56-accf3ea1d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:48.101544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:48.144675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c039a2b5-58aa-485d-bb56-accf3ea1d1a5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:48.147743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c039a2b5-58aa-485d-bb56-accf3ea1d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:48.264077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 676/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:48.596838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:48.597470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:48.598000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:48.600638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 695/1371] 10.222.0.49 () {54 vars in 964 bytes} [Mon Aug 1 14:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:48.606952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a93c-8240-43a0-9353-7269945b293b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:48.607246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a93c-8240-43a0-9353-7269945b293b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:48.607518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a93c-8240-43a0-9353-7269945b293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:48.705674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c6f3a93c-8240-43a0-9353-7269945b293b None None] MFA Rules not processed for user `b789d4e183f94b22b09e491728614fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:48.706946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c6f3a93c-8240-43a0-9353-7269945b293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:48.765917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:48.800166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 677/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Aug 1 14:12:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:48.812267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:48.813878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:48.876040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:48.937016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f00689-a1c5-4552-a293-ea4dae811320 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:49.028091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:49.028612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:49.028894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:49.029161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:49.030848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:49.140588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:49.155791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:49.157295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcd55a-7a33-4484-b9b6-243d0e5450a0 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:49.176705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 696/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:49.600083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:49.601691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:49.602219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:49.604589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 678/1374] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:12:49.609320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6f25-8329-4c5f-a2be-6af130e567bf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:49.609617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6f25-8329-4c5f-a2be-6af130e567bf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:49.610016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6f25-8329-4c5f-a2be-6af130e567bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:49.688802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-74af6f25-8329-4c5f-a2be-6af130e567bf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:49.690105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-74af6f25-8329-4c5f-a2be-6af130e567bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:49.812194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 697/1375] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:49.857051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:49.858595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:50.020870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0304-e640-43a3-a870-a9e9397b429f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:50.076170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:50.141424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:50.142090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:50.142375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:50.142774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:50.144422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:50.237711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:50.240058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41619943-b656-42c2-8255-3a6ba00746cf service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:50.259045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 679/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:52.535324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:52.535869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:52.536527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:52.538330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 698/1377] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:52.543946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ee3b-f4d6-4719-9669-1bc0fdb7931b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:52.544503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ee3b-f4d6-4719-9669-1bc0fdb7931b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:52.544503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ee3b-f4d6-4719-9669-1bc0fdb7931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:52.632581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fbc2ee3b-f4d6-4719-9669-1bc0fdb7931b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:52.633847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fbc2ee3b-f4d6-4719-9669-1bc0fdb7931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:52.641126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:52.740800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 680/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:52.790797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:52.792349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:52.859612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:52.984099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23779-b216-42d8-9d2d-130b357327c4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:53.150085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:53.151553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:53.152041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:53.152552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:53.155768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:53.179662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:53.274331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:53.276011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c97d-d2f2-4156-a2cc-9a295b527434 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:53.297494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 699/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:55.585579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:55.586160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:55.586160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:55.587703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 681/1380] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:55.593131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df37e-3220-4a99-94ce-98ffd8359da1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:55.593656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df37e-3220-4a99-94ce-98ffd8359da1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:55.593845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df37e-3220-4a99-94ce-98ffd8359da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:55.674223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2e9df37e-3220-4a99-94ce-98ffd8359da1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:55.675372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2e9df37e-3220-4a99-94ce-98ffd8359da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:55.791434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:55.798123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 700/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:55.843313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:55.844806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:55.996827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:56.010879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782814-1408-4c99-94b1-6926a3814549 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:56.150006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:56.150649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:56.150897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:56.151175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:56.152822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:56.261804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:56.263483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fd5a9-edfe-44bd-b3b0-c28daf10f91a service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:56.276656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:56.287667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 682/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:12:58.985478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:58.986780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:58.987774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:58.992751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 701/1383] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:12:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:59.002552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c2fb-3610-4f50-9676-321029e00619 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:59.003120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c2fb-3610-4f50-9676-321029e00619 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:59.003120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c2fb-3610-4f50-9676-321029e00619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:59.101803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6f39c2fb-3610-4f50-9676-321029e00619 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:59.103304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6f39c2fb-3610-4f50-9676-321029e00619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:59.231003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 683/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:12:59.283022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:59.284794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:59.474521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063539-e076-43f4-bdb3-15240a24650f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:59.566158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:59.627974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:59.628787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:59.629142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:59.630106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:59.632276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:59.738600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:59.740542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca0db5-3067-49f3-844b-4797ba79a9de service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:59.760567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 702/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:01.890487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:01.891077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:01.891077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:01.892496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 684/1386] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:01.898207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f351-18d1-4aaa-a808-13f9437e791c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:01.898715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f351-18d1-4aaa-a808-13f9437e791c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:01.898820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f351-18d1-4aaa-a808-13f9437e791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:01.975434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4197f351-18d1-4aaa-a808-13f9437e791c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:01.976725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4197f351-18d1-4aaa-a808-13f9437e791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:02.015697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:02.095419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 703/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:02.144287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:02.146144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:02.232799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:02.334518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88fe9d-0d01-4dbf-86fe-75f4e55e70e7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:02.461669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:02.462348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:02.462651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:02.462966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:02.464715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:02.513243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:02.574177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:02.575798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222aca5-4a29-4e09-a462-51635faf83cc service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:02.597575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 685/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:04.881414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:04.882003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:04.882107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:04.883462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 704/1389] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:04.888821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe25e-97b1-4910-955d-326ef1a467e4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:04.889326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe25e-97b1-4910-955d-326ef1a467e4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:04.889419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffe25e-97b1-4910-955d-326ef1a467e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:04.957189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c8ffe25e-97b1-4910-955d-326ef1a467e4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:04.958967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8ffe25e-97b1-4910-955d-326ef1a467e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.060513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 686/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:05.104339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:05.105906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.269107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565a6a-4fe2-4701-9d6e-09f9fcbeb103 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:05.288207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:05.392111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:05.392806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:05.393028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:05.393305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:05.395528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.449576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573ae5-e56a-4423-a476-38409b341239 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:05.450282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573ae5-e56a-4423-a476-38409b341239 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:05.450282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573ae5-e56a-4423-a476-38409b341239 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:05.451829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 687/1391] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:05.456839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4d32-94f6-4910-a9a5-e5949713b007 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:05.457112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4d32-94f6-4910-a9a5-e5949713b007 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:05.457398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4d32-94f6-4910-a9a5-e5949713b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:05.473728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:05.514676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:05.516305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee74f6d-dd93-4509-9e5b-ed745883b32b service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:05.535810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 705/1392] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:05.541810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-468d4d32-94f6-4910-a9a5-e5949713b007 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:05.542939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-468d4d32-94f6-4910-a9a5-e5949713b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.655492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 688/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:13:05.715133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:05.715422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:05.715701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:05.717057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 706/1394] 10.222.0.49 () {54 vars in 966 bytes} [Mon Aug 1 14:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:05.722121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077846e-0e6a-49d3-84d8-272af858521f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:05.722415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077846e-0e6a-49d3-84d8-272af858521f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:05.722695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077846e-0e6a-49d3-84d8-272af858521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:05.826784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7077846e-0e6a-49d3-84d8-272af858521f None None] MFA Rules not processed for user `a7c38ed92e03418ebf01b62f99a897c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:05.828056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7077846e-0e6a-49d3-84d8-272af858521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.870363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:05.917891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 689/1395] 10.222.0.49 () {58 vars in 1063 bytes} [Mon Aug 1 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:05.926182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:05.927716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:05.952418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:06.039438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5215d-bb00-470f-bf38-97f785945296 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:06.116380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:06.117003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:06.117285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:06.117562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:06.119215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:06.199300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:06.237573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:06.239652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620c55d-465c-43e6-93ed-72253fb0905c service glance] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:06.259391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 707/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:07.175902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604da9-aeba-47fa-90a8-ef5e5ddbbe11 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.176471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604da9-aeba-47fa-90a8-ef5e5ddbbe11 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.176596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604da9-aeba-47fa-90a8-ef5e5ddbbe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.244243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4b604da9-aeba-47fa-90a8-ef5e5ddbbe11 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:07.245455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4b604da9-aeba-47fa-90a8-ef5e5ddbbe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:07.342225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 690/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:07.388950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.389468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.389678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.391162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 708/1398] 10.222.0.49 () {54 vars in 943 bytes} [Mon Aug 1 14:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:07.398464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7cab-1a31-4848-978d-5dec3de9b601 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.398786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7cab-1a31-4848-978d-5dec3de9b601 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.399066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb7cab-1a31-4848-978d-5dec3de9b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.459871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:07.478842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-07bb7cab-1a31-4848-978d-5dec3de9b601 None None] MFA Rules not processed for user `2e5baeab919f40e2b92f155a0c34d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:07.480069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-07bb7cab-1a31-4848-978d-5dec3de9b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:07.598781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 691/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Mon Aug 1 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:07.608281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:07.609883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:07.753097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a539c56-33c3-411e-8e24-f6c0348e7cdc None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:07.797095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:07.811387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b706-a1d4-4d02-95cc-1dca705081bb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.811679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b706-a1d4-4d02-95cc-1dca705081bb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.811962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86b706-a1d4-4d02-95cc-1dca705081bb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.813338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 692/1400] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:13:07.818555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.818838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.819131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.876622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:07.877248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:07.877529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:07.878020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:07.880095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:07.897156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:07.898435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:07.966257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:08.018763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 693/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:08.068220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:08.069471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:08.107273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:08.109098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe19a5-b9f6-4b62-9641-3c228b4d9bfb service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:08.119588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 709/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:13:08.190623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9a428-5388-4c1c-8783-67074d9a64c6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:08.262303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:08.310381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:08.310913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:08.311197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:08.311471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:08.313087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:08.404477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:08.406157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cd434-1bb2-4ee7-8c6e-08a21222d6c8 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:08.427026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 694/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:13:10.690046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:10.690653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:10.690653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:10.692526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 710/1404] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:10.699901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ab29-9f2e-4157-9f31-7ee7cbb5f34a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:10.700450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ab29-9f2e-4157-9f31-7ee7cbb5f34a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:10.700450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ab29-9f2e-4157-9f31-7ee7cbb5f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:10.795416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a204ab29-9f2e-4157-9f31-7ee7cbb5f34a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:10.796735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a204ab29-9f2e-4157-9f31-7ee7cbb5f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:10.837156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:10.908643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 695/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:10.954974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:10.956862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:11.044466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:11.123426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1038fd8-c4fe-437d-a363-3a031718e929 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:11.244395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:11.245081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:11.245365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:11.245636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:11.247277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:11.292218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:11.348536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:11.350283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c0214-aab0-4936-a773-1cbc63db2473 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:11.372367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 711/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:13.664496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:13.665026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:13.665026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:13.670761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 696/1407] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:13:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:13.672622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12ec9-9eb7-4e29-af8c-61557ee414c9 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:13.673179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12ec9-9eb7-4e29-af8c-61557ee414c9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:13.673179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c12ec9-9eb7-4e29-af8c-61557ee414c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:13.752559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-64c12ec9-9eb7-4e29-af8c-61557ee414c9 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:13.754249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-64c12ec9-9eb7-4e29-af8c-61557ee414c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:13.881242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 712/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:13:13.927696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:13.929302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:14.119752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fc39-84b3-4414-8af1-c8a35834f3e9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:14.138689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:14.262799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:14.263445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:14.263734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:14.264015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:14.265731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:14.375792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:14.377560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e917-6604-4e68-ad64-7eda227dedef service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:14.402453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 697/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:23.878593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=94 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:24.399926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:32.383943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4f5f-a189-4b8c-885b-2252ada74ce9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:32.384525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4f5f-a189-4b8c-885b-2252ada74ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:32.384525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4f5f-a189-4b8c-885b-2252ada74ce9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:32.385889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 713/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon Aug 1 14:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:32.391052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576074c0-531f-4e77-b354-1685649a1e11 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:32.391529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576074c0-531f-4e77-b354-1685649a1e11 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:32.391633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576074c0-531f-4e77-b354-1685649a1e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:32.471780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-576074c0-531f-4e77-b354-1685649a1e11 None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:32.473258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-576074c0-531f-4e77-b354-1685649a1e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:32.583016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 698/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Aug 1 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:13:32.597551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a356f-568d-401d-ae09-ca96387f7435 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:32.597863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a356f-568d-401d-ae09-ca96387f7435 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:32.598144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a356f-568d-401d-ae09-ca96387f7435 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:32.599496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 714/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon Aug 1 14:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:32.604353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958335-452f-4614-8da2-f51421715316 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:32.604641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958335-452f-4614-8da2-f51421715316 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:32.604920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958335-452f-4614-8da2-f51421715316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:32.680226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:32.683401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-83958335-452f-4614-8da2-f51421715316 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:32.684631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-83958335-452f-4614-8da2-f51421715316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:32.812577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 699/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Aug 1 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:35.391527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:35.392103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:35.392103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:35.393597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:35.399926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287edb-790a-462b-8ea1-69b2aa0c0c0b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:35.400422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287edb-790a-462b-8ea1-69b2aa0c0c0b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:35.400531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287edb-790a-462b-8ea1-69b2aa0c0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:35.468514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c5287edb-790a-462b-8ea1-69b2aa0c0c0b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:35.469718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c5287edb-790a-462b-8ea1-69b2aa0c0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:35.528072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:35.576726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:35.621085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:35.622709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:35.778873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c34ee-51c4-4f53-9b07-a1635c2b66c6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:35.854169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:35.897634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:35.898282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:35.898563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:35.898833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:35.900459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:35.998246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:35.999837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97886b6e-548b-4b34-a2dd-c93b6f04ab8c service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:36.020753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 716/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:36.940182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:36.940722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:36.940722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:36.942266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:36.947566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67946ee-fe88-4cd1-8ac1-5a2f6557f6c1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:36.948117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67946ee-fe88-4cd1-8ac1-5a2f6557f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:36.948117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67946ee-fe88-4cd1-8ac1-5a2f6557f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:37.029833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a67946ee-fe88-4cd1-8ac1-5a2f6557f6c1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:37.031083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a67946ee-fe88-4cd1-8ac1-5a2f6557f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:37.062403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:37.138108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:37.290874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:37.292306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:37.448656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58437bca-3eb6-4cd0-a5d3-2c39b9befd43 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:37.490397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:37.570809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:37.571350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:37.571633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:37.571907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:37.573542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:37.664841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:37.666488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce774f-0ce1-4a19-8a2c-ca97ded088ac service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:37.685920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 702/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:13:38.589466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:38.590144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:38.590144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:38.591463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:38.599237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e870-14e0-4b9b-93b2-b547e0f77ede None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:38.599763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e870-14e0-4b9b-93b2-b547e0f77ede None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:38.599763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385e870-14e0-4b9b-93b2-b547e0f77ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:38.656025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:38.679532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b385e870-14e0-4b9b-93b2-b547e0f77ede None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:38.680765 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b385e870-14e0-4b9b-93b2-b547e0f77ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:38.783545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:38.938087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:38.939650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:39.093017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0406d4-31f0-4d96-97f4-47ea626e9002 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:39.105070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:39.208709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:39.209331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:39.209613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:39.209909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:39.211539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:39.302953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:39.304557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f47254-17fd-48b2-8854-1be959cf8e33 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:39.322832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 719/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:40.207257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:40.207840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:40.207840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:40.209199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:40.214382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297aa32-a658-4489-90cc-45cfa283491e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:40.214830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297aa32-a658-4489-90cc-45cfa283491e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:40.214942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297aa32-a658-4489-90cc-45cfa283491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:40.234919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:40.300138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-6297aa32-a658-4489-90cc-45cfa283491e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:40.301550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6297aa32-a658-4489-90cc-45cfa283491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:40.407116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:40.561114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:40.562567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:40.678305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:40.716006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3f0c-8201-49c4-9799-5588ba1361d9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:40.838106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:40.838730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:40.839011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:40.839284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:40.841069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:40.922070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:40.935953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:40.939585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be8b52-de33-424a-96f6-b2f5ddee397f service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:40.957324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 705/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:41.848226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:41.848798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:41.848798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:41.850156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:41.855429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d957-8241-4189-96ba-58c6bf769b3e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:41.855882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d957-8241-4189-96ba-58c6bf769b3e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:41.855991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d957-8241-4189-96ba-58c6bf769b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:41.934273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-48d9d957-8241-4189-96ba-58c6bf769b3e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:41.935513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-48d9d957-8241-4189-96ba-58c6bf769b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.035647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:42.193293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:42.194826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.283931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:42.361211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89c1c1-5e84-457a-82d0-6482597f08b9 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:42.485813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:42.486490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:42.486734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:42.486997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:42.489504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.543590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:42.591241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:42.592858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a7508-bc5c-49c5-9738-301f6f9ae947 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:42.612020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 722/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:43.497274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:43.497865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:43.497983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:43.499338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:43.505286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ed0f-dc43-404c-bd94-14958db18d0e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:43.505712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ed0f-dc43-404c-bd94-14958db18d0e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:43.505870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ed0f-dc43-404c-bd94-14958db18d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:43.585450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-69c0ed0f-dc43-404c-bd94-14958db18d0e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:43.586688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-69c0ed0f-dc43-404c-bd94-14958db18d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:43.690484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:43.846438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:43.848029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:43.899796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:44.001336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e8a25-988b-41f7-8cce-ac548a188786 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:44.117288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:44.117938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:44.118227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:44.118500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:44.120116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:44.127412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:44.214378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:44.215992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fb570-375a-45db-852d-882e1a813ef9 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:44.235073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 708/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:45.108426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.108996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.108996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.110402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:13:45.116173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f241-094c-44d1-9abc-649f914df24a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.116626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f241-094c-44d1-9abc-649f914df24a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.116721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f241-094c-44d1-9abc-649f914df24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.193694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fca0f241-094c-44d1-9abc-649f914df24a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:45.194944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fca0f241-094c-44d1-9abc-649f914df24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:45.265710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:45.296610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:45.449241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:45.450776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:45.469420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:45.608930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0123-7bd2-49dd-8a1b-940a9dca677e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:45.698387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:45.727502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:45.728124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.728401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.728672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.730312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:45.825775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:45.827418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519040c-eb1c-405f-9cd4-d04f51ba8721 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:45.846117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 725/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:13:46.718419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:46.718979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:46.718979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:46.720361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:46.726717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a770-8182-4a70-bd4a-0d9161abf59e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:46.727284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a770-8182-4a70-bd4a-0d9161abf59e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:46.727284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35a770-8182-4a70-bd4a-0d9161abf59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:46.812522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ea35a770-8182-4a70-bd4a-0d9161abf59e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:46.813789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ea35a770-8182-4a70-bd4a-0d9161abf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:46.860755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:46.918119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:47.070057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:47.071515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:47.337398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b069c-78a0-4db4-98fa-fee6828223fb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:47.392162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:47.454669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:47.455375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:47.455657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:47.455930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:47.457581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:47.553941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:47.555578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bd3e9-62b2-4236-8547-4dcd57ae70af service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:47.574715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 711/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:48.471587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:48.472770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:48.472770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:48.473531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:48.478922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cf9be-5fe3-4853-b613-984c2e48b401 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:48.479415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cf9be-5fe3-4853-b613-984c2e48b401 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:48.479525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cf9be-5fe3-4853-b613-984c2e48b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:48.561725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-936cf9be-5fe3-4853-b613-984c2e48b401 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:48.562963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-936cf9be-5fe3-4853-b613-984c2e48b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:48.565027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:48.664915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:48.855664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:48.857526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:49.019427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cecce-4bac-4948-aa01-3eab8e3022e2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:49.049800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:49.154207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:49.155250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:49.155728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:49.156207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:49.158576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:49.255507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:49.257129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e3eff-b64e-4d36-b086-51704fc699cb service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:49.276476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 728/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:51.202356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.202942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.202942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.204267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:51.210487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1a3f4-71e6-4ffa-bb00-85dc8ec6d96a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.210942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1a3f4-71e6-4ffa-bb00-85dc8ec6d96a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.211036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1a3f4-71e6-4ffa-bb00-85dc8ec6d96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.254213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:51.280913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-02a1a3f4-71e6-4ffa-bb00-85dc8ec6d96a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:51.282175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-02a1a3f4-71e6-4ffa-bb00-85dc8ec6d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.388224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:51.428664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:51.430369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.541031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9041c9-b73d-429a-b5cf-bd800d65e99d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:51.575013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:51.620996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:51.621704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.621978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.622257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.623904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.743752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:51.745189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4656dab-944a-4859-90ac-20b55e140750 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:51.764590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 714/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:53.983885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:53.984488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:53.984488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:53.985858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:53.992106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdb56-4cff-4e2c-9da0-5545da6eaaa3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:53.992572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdb56-4cff-4e2c-9da0-5545da6eaaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:53.992681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdb56-4cff-4e2c-9da0-5545da6eaaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:54.058933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-207cdb56-4cff-4e2c-9da0-5545da6eaaa3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:54.060061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-207cdb56-4cff-4e2c-9da0-5545da6eaaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.073409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:54.168587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:54.210294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:54.211808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.332442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0422-2e9d-40e9-9eb3-477178e7f934 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:54.346663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:54.421921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:54.422544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:54.422825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:54.423097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:54.424856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.559321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:54.560786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe8f6-5eaa-4ebe-af7d-3e5f876c21b1 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:54.583437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 731/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:57.120334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:57.120929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:57.120929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:57.122270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:57.127929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381e2cd-b228-4684-b6d5-d07789381330 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:57.128938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381e2cd-b228-4684-b6d5-d07789381330 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:57.129172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381e2cd-b228-4684-b6d5-d07789381330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:57.178526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:57.198353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7381e2cd-b228-4684-b6d5-d07789381330 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:57.199570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7381e2cd-b228-4684-b6d5-d07789381330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.304066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:57.343220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:57.344746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.454572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e8fc-f9b1-43a3-abc4-337ef0d64c20 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:57.495684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:57.528592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:57.529206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:57.529489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:57.529806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:57.532094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.643352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:57.645489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b831f0-1dd0-4a85-a702-2b595c51ec48 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:57.664169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 717/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:59.823039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:59.823604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:59.823714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:59.825126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:59.830929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c0a4c-176c-43f0-8c90-4e8895fb7015 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:59.832058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c0a4c-176c-43f0-8c90-4e8895fb7015 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:59.832174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c0a4c-176c-43f0-8c90-4e8895fb7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:59.898629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d71c0a4c-176c-43f0-8c90-4e8895fb7015 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:59.899888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d71c0a4c-176c-43f0-8c90-4e8895fb7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:59.920872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:00.000933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:00.042536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:00.044056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:00.152149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb7e52-7206-4013-8917-d408502608d9 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:00.172866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:00.235193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:00.235817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:00.236102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:00.236377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:00.238306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:00.348698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:00.350321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095335e-57ee-4e8e-95fe-c75a40477618 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:00.368586 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 734/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:02.523055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:02.524474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:02.524474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:02.525133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:02.531555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1c71-d99d-4a82-8458-c5a0b3de4806 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:02.532058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1c71-d99d-4a82-8458-c5a0b3de4806 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:02.532574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1c71-d99d-4a82-8458-c5a0b3de4806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:02.604943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:02.607888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7bea1c71-d99d-4a82-8458-c5a0b3de4806 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:02.609123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7bea1c71-d99d-4a82-8458-c5a0b3de4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:02.718075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:02.758768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:02.760561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:02.871348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282044f8-5451-483f-825a-e1ddd4b2360b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:02.920821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:02.946433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:02.947108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:02.947392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:02.947669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:02.949326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:03.057233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:03.058911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd39b3-94c7-45de-ae9c-8fadaa573914 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:03.078123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 720/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:05.176258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:05.176807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:05.176807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:05.178388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:05.183550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d6ff-3f13-4060-806d-78e299ba3fa6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:05.184019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d6ff-3f13-4060-806d-78e299ba3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:05.184170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d6ff-3f13-4060-806d-78e299ba3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:05.255977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4433d6ff-3f13-4060-806d-78e299ba3fa6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:05.257214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4433d6ff-3f13-4060-806d-78e299ba3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:05.286834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:05.355670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:05.394489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:05.396475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:05.506043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71603247-1a93-4b75-9ad0-4493c09a4c04 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:05.535594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:05.584513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:05.585136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:05.585416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:05.585692 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:05.588474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:05.697607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:05.699192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459c41-1b3e-468d-a68a-77f0cdf6a96d service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:05.718302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 737/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:07.800543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:07.801135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:07.801135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:07.802516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:07.807720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22031-f1db-4fff-b552-da928429c289 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:07.808156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22031-f1db-4fff-b552-da928429c289 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:07.808270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22031-f1db-4fff-b552-da928429c289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:07.874832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fdd22031-f1db-4fff-b552-da928429c289 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:07.876050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fdd22031-f1db-4fff-b552-da928429c289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:07.885222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:07.973218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:08.011078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:08.012610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:08.115994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97643b-971f-4798-bdcf-033a260c7047 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:08.171818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:08.189855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:08.191194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:08.191620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:08.191899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:08.193520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:08.300893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:08.302257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1bb4f-7ee8-480e-a727-90cab11b5161 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:08.320243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 723/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:10.407314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:10.407874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:10.407874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:10.410533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:10.417252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d7-345a-4e1f-90ee-e2e7547dd07c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:10.417797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d7-345a-4e1f-90ee-e2e7547dd07c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:10.418255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f586d7-345a-4e1f-90ee-e2e7547dd07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:10.486225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-60f586d7-345a-4e1f-90ee-e2e7547dd07c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:10.487718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-60f586d7-345a-4e1f-90ee-e2e7547dd07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:10.525156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:10.583544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:10.621572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:10.623148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:10.728042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079c60b-10c5-46ef-b798-348241361fa0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:10.766837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:10.806174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:10.808886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:10.808886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:10.808886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:10.809742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:10.928516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:10.929977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd916d-0b6a-428e-a446-62e8d00cc3db service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:10.949158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 740/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:12.980293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:12.980901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:12.980901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:12.982362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:12.988129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e07a-5050-4eb9-b7af-a9562da8d30d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:12.988792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e07a-5050-4eb9-b7af-a9562da8d30d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:12.988792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e07a-5050-4eb9-b7af-a9562da8d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:13.062394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b174e07a-5050-4eb9-b7af-a9562da8d30d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:13.063532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b174e07a-5050-4eb9-b7af-a9562da8d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:13.082132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:13.160161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:13.196992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:13.198562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:13.304822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8ab3-179c-45a2-a44a-092c10d04258 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:13.375462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:13.382327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:13.382954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:13.383232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:13.389408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:13.389408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:13.498333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:13.500048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780e957-cd9b-43d7-ad95-e0a0e77f1bab service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:13.518760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 726/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:15.576336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:15.576909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:15.576909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:15.578310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:15.584713 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75facc-4199-44ee-aba8-3fdc736f0489 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:15.585134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75facc-4199-44ee-aba8-3fdc736f0489 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:15.585271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75facc-4199-44ee-aba8-3fdc736f0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:15.650683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8c75facc-4199-44ee-aba8-3fdc736f0489 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:15.651874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8c75facc-4199-44ee-aba8-3fdc736f0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:15.701299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:15.749687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:15.788197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:15.789723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:15.895255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16295c-00dd-4b63-a24d-5f69e7317db7 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:15.941986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:15.967965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:15.968517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:15.968797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:15.969332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:15.972370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:16.086110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:16.087541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f99b36-4df9-4476-97b5-b1f2f78dac9d service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:16.106538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 743/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:25.747627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=22 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:26.103990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=66 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.937472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6992a2-7dd6-4f5b-a594-22fbd08dcebb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:35.938066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6992a2-7dd6-4f5b-a594-22fbd08dcebb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:35.938066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6992a2-7dd6-4f5b-a594-22fbd08dcebb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:35.939382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 728/1471] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:35.945089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940afbd-412e-4494-a562-abf52333103d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:35.945535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940afbd-412e-4494-a562-abf52333103d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:35.945663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940afbd-412e-4494-a562-abf52333103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.012448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f940afbd-412e-4494-a562-abf52333103d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:36.013730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f940afbd-412e-4494-a562-abf52333103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.110695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 744/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:36.195959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.196251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.196533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.197929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 729/1473] 10.222.0.49 () {54 vars in 966 bytes} [Mon Aug 1 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:36.202965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2f46c-afcd-4e55-9918-9d1272b06d5a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.203260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2f46c-afcd-4e55-9918-9d1272b06d5a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.203541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2f46c-afcd-4e55-9918-9d1272b06d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.279642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-64b2f46c-afcd-4e55-9918-9d1272b06d5a None None] MFA Rules not processed for user `a7c38ed92e03418ebf01b62f99a897c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:36.280773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-64b2f46c-afcd-4e55-9918-9d1272b06d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.301508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:36.357694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 745/1474] 10.222.0.49 () {58 vars in 1063 bytes} [Mon Aug 1 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:36.365911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:36.367424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.474267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ac5c5-6218-4c13-b3a1-954ef96fe323 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:36.548746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:36.549980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.550269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.550543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.552169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.607198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:36.671340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:36.672772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b917-b557-4cfe-ac0f-d32b257532ff service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:36.694221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 730/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:38.840632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:38.841200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:38.841200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:38.842566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 746/1476] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:38.848227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04796c-21db-4d21-a697-81d7198970c4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:38.848782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04796c-21db-4d21-a697-81d7198970c4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:38.848891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04796c-21db-4d21-a697-81d7198970c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:38.918015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ce04796c-21db-4d21-a697-81d7198970c4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:38.919248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ce04796c-21db-4d21-a697-81d7198970c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:39.020318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 731/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:39.044326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:39.045862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:39.179219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17194-ca54-4de5-bdb8-ccae8482ef0f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:39.229967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:39.281925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:39.282488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:39.282767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:39.283039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:39.284441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:39.286377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:14:39.286377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:14:39.286377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:14:39.287525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bd77b-bc11-4931-8bae-5018e042258b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:39.307196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 747/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Aug 1 14:14:39 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:14:41.417216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:41.417802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:41.417802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:41.422150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 732/1479] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:41.424962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c6c0-e9ca-4ecc-9329-c3e7bc99e41a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:41.425426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c6c0-e9ca-4ecc-9329-c3e7bc99e41a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:41.425570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c6c0-e9ca-4ecc-9329-c3e7bc99e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:41.499986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7059c6c0-e9ca-4ecc-9329-c3e7bc99e41a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:41.501198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7059c6c0-e9ca-4ecc-9329-c3e7bc99e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:41.604577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 748/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:41.649984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:41.651588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:41.662217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:41.823697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34dbc0-4813-410b-bc4c-aa59b3bafe97 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:41.909516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:41.944606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:41.945231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:41.945516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:41.945825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:41.948219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:42.041153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:42.042748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767cc3b-50f4-4436-a89a-1e1a73ffd530 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:42.062546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 733/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:44.289697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:44.290309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:44.290309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:44.291667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 749/1482] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:44.297222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b968c-1038-4f04-b0a6-64202cf7569b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:44.297738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b968c-1038-4f04-b0a6-64202cf7569b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:44.297866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b968c-1038-4f04-b0a6-64202cf7569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:44.368390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cb4b968c-1038-4f04-b0a6-64202cf7569b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:44.369642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cb4b968c-1038-4f04-b0a6-64202cf7569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:44.419719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:44.475613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 734/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:44.513414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:44.515021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:44.540564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:44.624889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda256-a6ad-4a40-b935-a872a10a5d04 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:44.703004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:44.703636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:44.703957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:44.704265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:44.706012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:44.786534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:44.823358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:44.824715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99652d-7795-4e8f-a7ce-307b205d1c12 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:44.843330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 750/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:46.955077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:46.955615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:46.955615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:46.956960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 735/1485] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:46.962600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933a05-27cb-4989-bcfd-6a29f86d7dce None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:46.963098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933a05-27cb-4989-bcfd-6a29f86d7dce None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:46.963207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5933a05-27cb-4989-bcfd-6a29f86d7dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:47.030826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a5933a05-27cb-4989-bcfd-6a29f86d7dce None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:47.031953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a5933a05-27cb-4989-bcfd-6a29f86d7dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:47.136703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 751/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:47.176180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:47.177844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:47.278911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6449201-0e73-41ab-96e4-3b5870a9e357 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:47.354933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:47.356596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:47.357259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:47.357539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:47.357836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:47.359447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:47.478263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:47.479701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0483f-4c2d-4dc0-925d-04295af50ac4 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:47.498956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 736/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:49.686973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:49.687538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:49.687538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:49.688948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 752/1488] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:49.695968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897777a8-6c8c-4743-898f-ed4f68c0dad5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:49.700833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897777a8-6c8c-4743-898f-ed4f68c0dad5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:49.700833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897777a8-6c8c-4743-898f-ed4f68c0dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:49.767225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-897777a8-6c8c-4743-898f-ed4f68c0dad5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:49.769428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-897777a8-6c8c-4743-898f-ed4f68c0dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:49.831807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:49.878334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 737/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:49.918888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:49.920403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:49.958854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:50.031501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1f47-c19b-4970-b8fd-65e6387f1961 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:50.107428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:50.108051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:50.108335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:50.108610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:50.110266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:50.195583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:50.228677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:50.230170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667aff8-fb4d-4316-bd50-1f19cad01f7d service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:50.249646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 753/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:14:52.852574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e94943-fccc-4938-994a-efd8510a683c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.853113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e94943-fccc-4938-994a-efd8510a683c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.853243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e94943-fccc-4938-994a-efd8510a683c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.854562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 738/1491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Aug 1 14:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:52.868820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4af6-c625-4d7f-88bd-deb79c1d0d2b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.869360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4af6-c625-4d7f-88bd-deb79c1d0d2b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.869360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e4af6-c625-4d7f-88bd-deb79c1d0d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.937019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4c7e4af6-c625-4d7f-88bd-deb79c1d0d2b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:52.938345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4c7e4af6-c625-4d7f-88bd-deb79c1d0d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.037205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 754/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:53.077352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e94943-fccc-4938-994a-efd8510a683c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:53.078975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-14e94943-fccc-4938-994a-efd8510a683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.188800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e94943-fccc-4938-994a-efd8510a683c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:53.265597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:53.266268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.266556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.266836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.269308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.278890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:53.381313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:53.382816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337c95-3c22-496b-8f18-c26b9ed9bb9c service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:53.402399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 739/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:03.035342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=82 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:03.400137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=50 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.499323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:32.500121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:32.500121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:32.581161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:32.582443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.687793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 755/1494] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:32.696313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:32.696803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:32.696908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:32.776065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:32.777287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.881867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 740/1495] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:32.886514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:32.887717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.899686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47204e09-c33f-4600-a777-ff0d5923f9ab None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:32.960040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.994814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:32.995714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:32.996236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:32.996544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:32.997497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:16:32.998104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:32.999403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:32.999403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:16:32.999403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:16:33.001347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:33.012634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 756/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:16:33.021842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:33.031636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92aa4-1ac7-48ab-97c6-66b66a2ba7ff None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:33.093989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.130334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:33.130962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:33.131275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:33.131554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:33.132223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:33.134130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:33.134130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:16:33.134130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:16:33.135336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:33.272177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 741/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:16:33 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:16:33.276436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:33.277994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:33.314755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98071-2b05-4564-9e4a-6fb29c9bc5b2 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:33.413120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:33.413740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:33.414048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:33.414318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:33.414989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:33.415994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:33.415994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:16:33.415994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:16:33.417209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:33.552805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 757/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:16:33 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:16:33.557070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:33.558632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:33.621871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d688b-c7f4-47c8-ba7c-cf121ebd6ed5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:33.708253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.719391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:33.720035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:33.720304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:33.720579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:33.721278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:33.722318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:33.722318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:16:33.722318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:16:33.723211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:33.737145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 742/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:16:33.741411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:33.743088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:33.755883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9521970-f436-413e-8c26-83d8bd8be0e7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:33.783769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:33.857077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:33.857700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:33.858004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:33.858273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:33.858964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:33.860571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:33.860571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:16:33.860571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:16:33.861460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303036-45a9-42f4-80a2-62ca7ebc9343 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:33.875500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 758/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:16:33.880324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:33.881936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:33.915252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d1b65-a801-4c30-87d5-f412b186b56c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:34.012254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:34.012958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.013241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.013520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] PATH_INFO: `/v3/projects/b918102e28684a929790daa4e1e77101/users/8d5f0ce481024c26b337d647c53cff7a/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.036900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b918102e28684a929790daa4e1e77101, user_id=8d5f0ce481024c26b337d647c53cff7a, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:34.037974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:34.037974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:16:34.037974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:16:34.040042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010987b-664e-496a-b08a-a0e670ea00f9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:34.162590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 743/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:16:33 2022] PUT /identity/v3/projects/b918102e28684a929790daa4e1e77101/users/8d5f0ce481024c26b337d647c53cff7a/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:16:34.175810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268de5b-69e5-4ec4-909e-88ce936625a4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.176198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268de5b-69e5-4ec4-909e-88ce936625a4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.176480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268de5b-69e5-4ec4-909e-88ce936625a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.233954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c268de5b-69e5-4ec4-909e-88ce936625a4 None None] MFA Rules not processed for user `8d5f0ce481024c26b337d647c53cff7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:34.236072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c268de5b-69e5-4ec4-909e-88ce936625a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.317195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 759/1502] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:34.331280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.331571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.331854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.333204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 744/1503] 10.222.0.49 () {54 vars in 964 bytes} [Mon Aug 1 14:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:34.338237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd722065-630c-47f3-b357-3d983aa6b1c7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.338533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd722065-630c-47f3-b357-3d983aa6b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.338813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd722065-630c-47f3-b357-3d983aa6b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.371762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:34.420491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-cd722065-630c-47f3-b357-3d983aa6b1c7 None None] MFA Rules not processed for user `b789d4e183f94b22b09e491728614fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:34.421616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cd722065-630c-47f3-b357-3d983aa6b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.499577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 760/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Aug 1 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:34.507285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:34.508849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.563437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:34.620192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e0c57-bd73-49e2-9371-e193f77f5489 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:34.698505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:34.699044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.699328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.699605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.701217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.805471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:34.806974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:34.810607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:34.826237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 745/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:34.873788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ef0c-c222-4240-be41-3760033bc7fa None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.874271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ef0c-c222-4240-be41-3760033bc7fa None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.874365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19ef0c-c222-4240-be41-3760033bc7fa None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.876343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 761/1506] 10.222.0.49 () {52 vars in 830 bytes} [Mon Aug 1 14:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:34.880389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:34.881608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.985786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64387859-b622-41d9-bf0a-6715fb7daea6 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:35.089336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:35.090002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:35.090281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:35.090554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] PATH_INFO: `/v3/users/8d5f0ce481024c26b337d647c53cff7a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:35.104010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5f0ce481024c26b337d647c53cff7a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:35.105078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:35.105078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:16:35.105078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:16:35.106336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:35.117039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:35.307506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5f0ce481024c26b337d647c53cff7a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:35.307873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5f0ce481024c26b337d647c53cff7a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:35.334358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5f0ce481024c26b337d647c53cff7a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:35.334865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5f0ce481024c26b337d647c53cff7a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:35.400095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5f0ce481024c26b337d647c53cff7a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:35.422235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 746/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:16:34 2022] DELETE /identity/v3/users/8d5f0ce481024c26b337d647c53cff7a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:16:35.426578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:35.426871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:35.427157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:35.490113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:35.491338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:35.574705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:35.593305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 762/1508] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:35.603245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:35.604523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:35.712459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a2b0a-8ada-4a81-908c-7bf7c9bd0b11 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:35.771409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:35.796576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:35.797217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:35.797652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:35.797963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:35.799662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:35.913269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:35.914750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065694-4e2f-4029-82ec-43f83a967677 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:35.934706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 747/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:16:36.650612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:36.651834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:36.664937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67e07-5c60-4d24-be9c-3ff3b5481587 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:36.772141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:36.772798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:36.773076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:36.773350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] PATH_INFO: `/v3/projects/b918102e28684a929790daa4e1e77101` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:36.784911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b918102e28684a929790daa4e1e77101)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:36.786023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:36.786023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:16:36.786023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:16:36.787273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:36.904976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b918102e28684a929790daa4e1e77101', 'request_id': 'req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:36.918555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b918102e28684a929790daa4e1e77101', 'request_id': 'req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:36.926226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b918102e28684a929790daa4e1e77101', 'request_id': 'req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:37.004366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] The token cache is being invalidate because project b918102e28684a929790daa4e1e77101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:16:37.004656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:37.005181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d0e35b04-c29a-4b81-b85e-d73ac2cbb27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:16:37.006744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 763/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:16:36 2022] DELETE /identity/v3/projects/b918102e28684a929790daa4e1e77101 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:16:45.932189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=62 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:47.002270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:19.628662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:19.629272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:19.629272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:19.631726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:19.636808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ed45-cf28-41b1-9eed-f0c649b9d8f3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:19.637327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ed45-cf28-41b1-9eed-f0c649b9d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:19.637432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852ed45-cf28-41b1-9eed-f0c649b9d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:19.728309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a852ed45-cf28-41b1-9eed-f0c649b9d8f3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:19.729554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a852ed45-cf28-41b1-9eed-f0c649b9d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:19.857124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:20.014671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:20.016797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:20.141653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41802ce1-c59f-4128-a756-aa1198a7f66b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:20.147256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:20.147891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:20.148284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:20.148456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:20.157119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:20.158803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8330e-7705-4441-9a02-508aac1e48e2 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:20.168943 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 749/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:21.011864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac581-2af7-42e9-a563-5e98215a0a72 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:21.012434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac581-2af7-42e9-a563-5e98215a0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:21.012434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac581-2af7-42e9-a563-5e98215a0a72 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:21.013848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:18:21.019548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71198-d4ec-4267-bf24-9632f00ea252 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:21.020018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71198-d4ec-4267-bf24-9632f00ea252 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:21.020018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e71198-d4ec-4267-bf24-9632f00ea252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:21.041992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-13e71198-d4ec-4267-bf24-9632f00ea252 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:21.043199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-13e71198-d4ec-4267-bf24-9632f00ea252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:21.051385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:21.206180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac581-2af7-42e9-a563-5e98215a0a72 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:21.220852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac581-2af7-42e9-a563-5e98215a0a72 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:21.227480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:21.228100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:21.228379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:21.228657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:21.237299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:21.238912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572e78-fb57-4b3c-8620-16ea5cdac29b service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:21.250071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 766/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:21.736888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531121c-9fbf-4809-bb1a-7bb3db682e01 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:21.737177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531121c-9fbf-4809-bb1a-7bb3db682e01 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:21.737463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531121c-9fbf-4809-bb1a-7bb3db682e01 None None] PATH_INFO: `/v3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:21.738811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 751/1517] 10.222.0.72 () {54 vars in 925 bytes} [Mon Aug 1 14:18:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:18:21.745613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e337f-c178-40c3-81fb-a5876dfb0cc7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:21.745928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e337f-c178-40c3-81fb-a5876dfb0cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:21.746230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e337f-c178-40c3-81fb-a5876dfb0cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:21.811663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-741e337f-c178-40c3-81fb-a5876dfb0cc7 None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:21.812864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-741e337f-c178-40c3-81fb-a5876dfb0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:21.830640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:21.888588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 767/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 1 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:18:31.037725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=56 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:31.237317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021fcc6-004e-47ea-96ab-33093764495a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:31.237594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021fcc6-004e-47ea-96ab-33093764495a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:31.237906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021fcc6-004e-47ea-96ab-33093764495a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:31.239271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 752/1519] 10.222.0.49 () {54 vars in 961 bytes} [Mon Aug 1 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:31.244484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793d6-6a0d-4495-b18c-4c57f51b146b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:31.244987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793d6-6a0d-4495-b18c-4c57f51b146b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:31.245082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793d6-6a0d-4495-b18c-4c57f51b146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:31.264956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a88793d6-6a0d-4495-b18c-4c57f51b146b None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:31.266212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a88793d6-6a0d-4495-b18c-4c57f51b146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:31.275507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 768/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Aug 1 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:31.282978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021fcc6-004e-47ea-96ab-33093764495a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:31.297512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021fcc6-004e-47ea-96ab-33093764495a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:31.302834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:31.303466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:31.303755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:31.304042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:31.312508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:31.314120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db4a62-4178-467a-a0ab-4bbc3ca90af2 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:31.323841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 753/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:32.541144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc38-e319-45f6-9215-b2e9b7e77434 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:32.541666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc38-e319-45f6-9215-b2e9b7e77434 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:32.541666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc38-e319-45f6-9215-b2e9b7e77434 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:32.543003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:32.548033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da95747-96b6-421e-ba17-5d4a411b37e7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:32.548495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da95747-96b6-421e-ba17-5d4a411b37e7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:32.548614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da95747-96b6-421e-ba17-5d4a411b37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:32.569667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9da95747-96b6-421e-ba17-5d4a411b37e7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:32.570925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9da95747-96b6-421e-ba17-5d4a411b37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:32.579379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:32.735144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957dc38-e319-45f6-9215-b2e9b7e77434 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:32.750745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957dc38-e319-45f6-9215-b2e9b7e77434 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:32.756811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:32.757484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:32.757796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:32.758078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:32.766954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:32.771078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e0e5d-e570-4306-919f-04864b97d065 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:32.778639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 770/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:33.608468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e776c-48b1-4a59-8ef6-bbb5ebb69c46 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:33.608990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e776c-48b1-4a59-8ef6-bbb5ebb69c46 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:33.609118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e776c-48b1-4a59-8ef6-bbb5ebb69c46 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:33.610426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:33.615454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fb7c-881a-49ab-9ec1-c3955ed0fcbe None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:33.615853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fb7c-881a-49ab-9ec1-c3955ed0fcbe None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:33.616014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6fb7c-881a-49ab-9ec1-c3955ed0fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:33.635615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1ce6fb7c-881a-49ab-9ec1-c3955ed0fcbe None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:33.636822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1ce6fb7c-881a-49ab-9ec1-c3955ed0fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:33.644784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:33.801857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e776c-48b1-4a59-8ef6-bbb5ebb69c46 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:33.822982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e776c-48b1-4a59-8ef6-bbb5ebb69c46 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:33.828415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:33.828973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:33.829260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:33.829539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:33.839987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:33.841600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfc48e-777f-445d-bd25-5e5141e12984 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:33.853473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 756/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:38.047287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:38.047884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:38.047884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:38.049223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:38.055180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7bd8-88bd-4221-9985-842a0edd97e6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:38.055615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7bd8-88bd-4221-9985-842a0edd97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:38.055727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7bd8-88bd-4221-9985-842a0edd97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:38.075764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6dbc7bd8-88bd-4221-9985-842a0edd97e6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:38.076961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6dbc7bd8-88bd-4221-9985-842a0edd97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:38.084942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:38.158133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:38.159818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:38.238701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92444f5-2e62-4f3e-8622-cf0b370ab96f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:38.242897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:38.243519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:38.243801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:38.244077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:38.253410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:38.254871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c064b8-d441-44fe-b0f1-ca9356c561b9 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:38.264904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 773/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:40.288723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877afad-c4e8-49ba-907e-4259385f037b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:40.289309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877afad-c4e8-49ba-907e-4259385f037b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:40.289309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877afad-c4e8-49ba-907e-4259385f037b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:40.290647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:40.295820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036fc1-85a6-4749-a0cf-7a81f895f66c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:40.296226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036fc1-85a6-4749-a0cf-7a81f895f66c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:40.296387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22036fc1-85a6-4749-a0cf-7a81f895f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:40.316027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-22036fc1-85a6-4749-a0cf-7a81f895f66c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:40.317242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-22036fc1-85a6-4749-a0cf-7a81f895f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:40.325268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:40.361693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877afad-c4e8-49ba-907e-4259385f037b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:40.373834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877afad-c4e8-49ba-907e-4259385f037b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:40.377451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:40.378095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:40.378377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:40.378658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:40.389279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:40.390712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc644037-0fc1-4a9e-a45b-3eca1ab284dc service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:40.400738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 759/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:44.219004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:44.219534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:44.219534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:44.220824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:44.226526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8ff7-84e3-4c68-9ed0-fb5cc6e0ec4f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:44.226956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8ff7-84e3-4c68-9ed0-fb5cc6e0ec4f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:44.227088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8ff7-84e3-4c68-9ed0-fb5cc6e0ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:44.247427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2b4c8ff7-84e3-4c68-9ed0-fb5cc6e0ec4f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:44.253844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2b4c8ff7-84e3-4c68-9ed0-fb5cc6e0ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:44.257384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:44.564834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:44.566486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:44.634849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:44.648356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c312fa-fb3a-4af9-8a1e-827ed457f902 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:44.652040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:44.652659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:44.652941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:44.653217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:44.662572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:44.664002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf616c53-1373-49c4-a9d3-1806327074d6 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:44.673594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 776/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:46.747086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:46.747658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:46.747658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:46.749036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:46.754207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257775-545e-4abf-a2ab-4c35c0c51df7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:46.754610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257775-545e-4abf-a2ab-4c35c0c51df7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:46.754766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9257775-545e-4abf-a2ab-4c35c0c51df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:46.776447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b9257775-545e-4abf-a2ab-4c35c0c51df7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:46.777640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b9257775-545e-4abf-a2ab-4c35c0c51df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:46.785408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:47.100087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:47.101786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:47.115504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d0f6f-cbe8-40e7-ad50-c3e770dfb9fb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:47.119056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:47.119663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:47.119941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:47.120220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:47.129347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:47.131472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b1c46-4b5c-4f1c-97f2-4a50c1a94f1e service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:47.140859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 762/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:56.770495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=11 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:57.136611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=33 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:19.025424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.026180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.026180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.060244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.061704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.075243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 778/1540] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.084865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.086153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.086740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.127006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.128295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.141509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 763/1541] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.146377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.159513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39244-9a96-468e-b49e-d1272d8c3672 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.176083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.176727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.177008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.177282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.178012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:19.178328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.180598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682a52f-3058-42da-84bd-4164da990bb2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.204539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 779/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:19.213392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.227374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb46ad-8c3f-445d-9512-b39ace970927 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.238410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.239059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.239350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.239637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.240333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.243101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6a69a-c30e-42a0-ac35-099cbcdd550e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.296465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f5e2-97a8-42e9-96b5-c4d0e64941f4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.296673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f5e2-97a8-42e9-96b5-c4d0e64941f4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.296946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f5e2-97a8-42e9-96b5-c4d0e64941f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.325577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-29a0f5e2-97a8-42e9-96b5-c4d0e64941f4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.326837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-29a0f5e2-97a8-42e9-96b5-c4d0e64941f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.340347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 780/1543] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:19.341847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc38-0f39-4ce9-a583-a8f694c7a930 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.346106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc38-0f39-4ce9-a583-a8f694c7a930 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.346106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc38-0f39-4ce9-a583-a8f694c7a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.378005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b526cc38-0f39-4ce9-a583-a8f694c7a930 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.378888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b526cc38-0f39-4ce9-a583-a8f694c7a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.389248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 764/1544] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:19.394479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c147-9433-430b-a065-c96914655aea None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.395689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c147-9433-430b-a065-c96914655aea None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.396237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c147-9433-430b-a065-c96914655aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.400310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 781/1545] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.402127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b556e-dde9-40f1-810a-2699194fde24 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.402127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b556e-dde9-40f1-810a-2699194fde24 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.402413 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b556e-dde9-40f1-810a-2699194fde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.434748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bb63c147-9433-430b-a065-c96914655aea None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.434980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a12b556e-dde9-40f1-810a-2699194fde24 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.436611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a12b556e-dde9-40f1-810a-2699194fde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.437322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bb63c147-9433-430b-a065-c96914655aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.539410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 765/1546] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.540311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c147-9433-430b-a065-c96914655aea None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.559015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c147-9433-430b-a065-c96914655aea None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.574358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.575128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.575633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.575759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 782/1547] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.575855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.576359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.576716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332c04-5bb6-4bcc-9571-75c754268337 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.577006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332c04-5bb6-4bcc-9571-75c754268337 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.577288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47332c04-5bb6-4bcc-9571-75c754268337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.577471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:19.577471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:20:19.577471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:20:19.578731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40f5a4-53f3-48ff-96a4-dd7257071bda admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.598703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-47332c04-5bb6-4bcc-9571-75c754268337 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.603645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-47332c04-5bb6-4bcc-9571-75c754268337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.609118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 783/1548] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.610455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.610744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.611020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.630542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.631824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.644296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 784/1549] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.644296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.653166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e70cd5-3904-448f-9654-1a7204f0f052 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.658026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.658653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.658935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.659208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.659904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:19.660207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.661919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f5640-3388-4b66-94b7-29717628bdde admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.674368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 785/1550] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:19.675759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94912ea-e872-4503-88ce-113211f02489 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.676051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94912ea-e872-4503-88ce-113211f02489 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.676322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94912ea-e872-4503-88ce-113211f02489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.687145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 766/1551] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:19.692032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0dec-def4-4759-b4cc-6dade8f22e4d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.692032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0dec-def4-4759-b4cc-6dade8f22e4d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.692032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da0dec-def4-4759-b4cc-6dade8f22e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.699732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e94912ea-e872-4503-88ce-113211f02489 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.700965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e94912ea-e872-4503-88ce-113211f02489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.709536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 786/1552] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.718570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.718570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.718570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.718899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-11da0dec-def4-4759-b4cc-6dade8f22e4d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.718899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-11da0dec-def4-4759-b4cc-6dade8f22e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.729982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 767/1553] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.731278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83da72-488b-4279-b6fb-ff18f56dfb3c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.731569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83da72-488b-4279-b6fb-ff18f56dfb3c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.731848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83da72-488b-4279-b6fb-ff18f56dfb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.743760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.747350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.754433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 787/1554] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.755364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4b83da72-488b-4279-b6fb-ff18f56dfb3c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.756084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.756601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4b83da72-488b-4279-b6fb-ff18f56dfb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.767322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e7d61-779d-42bb-8a16-7df8863fb5a0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.772000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.778350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 768/1555] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.778484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.778588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.778678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.778766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.778856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.778940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.779036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:19.779036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.779036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.799436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 788/1556] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:19.799436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.805259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.806506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.809726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c471a-6bd8-4bc3-b413-7aab004681cf admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.814325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.814914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 769/1557] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.816176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.816176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.816176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.816485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.816587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.817309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:19.817309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:20:19.817309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:20:19.818661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98910b13-c745-4707-8497-25ee4f731f51 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.828779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341485d0-8e83-495a-8449-8ecbbe07a717 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.834459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.835362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.835807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.836269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.837297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.839438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1f553-eb0c-4a1e-beb4-b7925c5f9186 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.851253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 770/1558] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:19.852611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3e12-9b25-4ac8-b092-a7f8f4258eb8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.852899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3e12-9b25-4ac8-b092-a7f8f4258eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.853174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3e12-9b25-4ac8-b092-a7f8f4258eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.877548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-34dd3e12-9b25-4ac8-b092-a7f8f4258eb8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.878825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-34dd3e12-9b25-4ac8-b092-a7f8f4258eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.888291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 771/1559] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.889794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.890087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.890368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.911412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 789/1560] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:19.911412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.911412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.911412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.911844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.912529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.931368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.932570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.976665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 772/1561] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.977779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.987491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceac1a-cf1a-475d-8e72-3dfab3832d47 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.990517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:19.992468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.993085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.993376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.993650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.994378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:19.994686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.995964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:19.995964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:20:19.995964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:20:19.996847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.999366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:20.006985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 790/1562] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:20.006985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.017545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 773/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:20.017545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.017901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eee59-d68e-4b05-9219-38ad4a827c19 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.021568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.022246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.023295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.023295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.024162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.026500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.029902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02adebe-7b39-423e-9a20-682c4f4848ee admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.035674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.036312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.036646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.036928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.037627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:20.037954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.040564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.052925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 774/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:20.058325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.065356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797d38-d256-4312-8c1b-56559c999912 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.070683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.071311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.071623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.071902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.072612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.074281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.086558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 775/1565] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:20.087392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.097706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69848b3-da2f-418c-bf0a-fdc775ffe252 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.104289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.104977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.105251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.105524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.106359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:20.106673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.108319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.109994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 791/1566] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.110983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.129533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 776/1567] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:20.129533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.140335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2a17-9b6c-4a50-86f0-316fe6779374 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.176952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c7d4b-825f-43cb-a559-8daa726e6d70 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.182122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.182737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.183018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.183447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.183948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.185954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.198372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.198997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.199310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.199558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.200250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:20.200556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.202189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.214270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 777/1568] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:20.215068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.224488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6cac-a73e-40e4-9226-f566d9766ea8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.229775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.230406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.230685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.230973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.231676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:20.231977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.233538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.245682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 778/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:20.250378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.256112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff0ba1-6b6b-4e11-aae6-a95a528e1773 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.261085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.261677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.262041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.262322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.262974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.264837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.274876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 792/1570] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.274876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.284613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f669e-2613-4e59-a95a-676e959d4c15 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.290075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.290693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.290977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.291256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.291927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.293878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.409364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 793/1571] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.410443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.422200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 779/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.439738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.474922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b1576-166d-4f15-afd7-177b7bf130a9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.487621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9b91-5248-4bd2-a2ba-dbe648c94e93 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.492338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.492957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.493244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.493523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.494224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.496439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.519909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:20.533064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.533736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.534046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.534321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] PATH_INFO: `/v3/projects/bc42d81a7cfc4d7680da35485637950e/users/d706df932ec748539d250c64f729c44e/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.548605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc42d81a7cfc4d7680da35485637950e, user_id=d706df932ec748539d250c64f729c44e, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.549632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:20.549632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:20:20.549632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:20:20.551620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.599626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 780/1573] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.599626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.606904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db095e4-4961-4c85-8fc3-547d5dac4499 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.611521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.612441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.612728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.613036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.613659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.615608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.619728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 794/1574] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:20 2022] PUT /identity/v3/projects/bc42d81a7cfc4d7680da35485637950e/users/d706df932ec748539d250c64f729c44e/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:20.632737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:20.632976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.686940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c474-a1ef-4f86-a6b5-e3ac18bfe74f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.691530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.692220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.692504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.692781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.693458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.695981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.707913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 781/1575] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.709123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.773705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45717e7d-a804-442e-a566-626d704dec52 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.778512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.779137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.779420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.779692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.780364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.782299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.799579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 795/1576] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.800560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.860743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 782/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:20.861556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.863350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e428c-a84b-42d1-bbf7-6f2612dd5506 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.922458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.923078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.923358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.923632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.924323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.925043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429df4b-f13f-4610-a38c-c9e9b26a338a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.925940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.927992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:20.931006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.931534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.931830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.932110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.932790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.934794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:20.939971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 796/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:20.939971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:20.948860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84b59a-28e0-4444-bc33-866206f2b8ae admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:20.953544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:20.954220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:20.954503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:20.954778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:20.955436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:20.957812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41949f01-6ba8-497f-be3b-7b5d71d8586d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.045358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 783/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.045358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.053254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d941-6d64-4b50-a801-51fc99e48709 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.058726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.059337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.059693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.059950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.063166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 797/1580] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:20 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.063656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.063768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.063768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.063768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.064035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.075920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 784/1581] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.075920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.085255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271779-ae4b-4275-a348-e0310a08d351 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.090160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.090764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.091052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.091333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.091991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.092783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] MFA Rules not processed for user `d706df932ec748539d250c64f729c44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:21.093935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.094063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:21.159689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 798/1582] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:21.160580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.171142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8012484-276d-42c0-94d2-9352663ae118 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.175814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.176414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.176695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.176967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.177795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.180340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.200486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 785/1583] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.200486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.208931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d2acc-d60e-4335-a3aa-75de3d6de769 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.213877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.214470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.214754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.215031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.215680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.217588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.267207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 799/1584] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.267842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.279008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31f4c-8346-4c0c-ae5c-b3ffe3b1974e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.283561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.284164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.284444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.284714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.285399 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.287010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.299127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 800/1585] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.299127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.309374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166cf06-f4c9-453e-baf2-77b2da9f9926 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.313907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.314493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.314773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.315046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.315711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.317273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.327185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 786/1586] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.327185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.331632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 801/1587] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.331632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.334829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa70a-adef-4c32-a2a8-961d81da391c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.339704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.340319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.340606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.340885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.341577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.342171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df133f-9f30-4345-a932-3688244bd5e9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.343231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.346808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.347411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.347693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.347971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.348651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.350260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.354620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 787/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.355415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.360409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:21.362798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 802/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.365352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd72a-c7c0-428e-909b-d0f3e8a9cf0e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.367491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.371178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.371829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.375040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.375040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.375040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.375040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.377824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971259-0053-4e26-bb0c-a91f37a9f920 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.382625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.383243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.383528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.383806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.384554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.386314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.396941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 803/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.398018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.408419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b1730-da0a-4e0e-80d7-ca5d2e3a487d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.413718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.414420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.414705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.414978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.415662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.417241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.428011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 804/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.429406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.438945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b5b92-c6ae-4d52-ab34-3c65561d351d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.443764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.444559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.445123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.445272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] PATH_INFO: `/v3/projects/c80bd4eb290541d8a713ea5ba60d0de4/users/6b46ac5a29594c41a83e70838b0a13c8/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.459870 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80bd4eb290541d8a713ea5ba60d0de4, user_id=6b46ac5a29594c41a83e70838b0a13c8, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.463260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.483951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 788/1592] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.483951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.535945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 805/1593] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/c80bd4eb290541d8a713ea5ba60d0de4/users/6b46ac5a29594c41a83e70838b0a13c8/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:21.536930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.543513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13217349-e9aa-4c0c-b369-ac3215588b5f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.577195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:21.603147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.603771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.604054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.604331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.605050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.605634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c9bc-8166-4810-aba4-00d16638ffa1 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.606684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.610618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.611235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.611518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.611790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.612484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.614101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.620768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 789/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.620768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.626332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 806/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.627143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.628826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce53b-62f4-4589-ae7a-840329ab2602 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.634214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.634828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.635111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.635387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.636073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.637655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.639282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461b66-5589-4515-9465-aae181a218a7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.644412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.645076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.645360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.645634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] PATH_INFO: `/v3/projects/3f7ea2daaa864df7973b21d1d13ae47a/users/47da4644803547869a303a039ee7a28c/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.649649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 790/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.650599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.660404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7199-d107-47ba-aefd-80e99c60e3e8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.662928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7ea2daaa864df7973b21d1d13ae47a, user_id=47da4644803547869a303a039ee7a28c, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.665771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.666213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dda39-e556-4491-812f-b28dab68d231 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.666389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.666697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.666951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.667638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.669214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.679813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 791/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.680606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.690307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa03e2-b345-4b8b-bfb5-f8306a067619 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.695094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.695696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.695979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.696258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.696935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.698578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.708535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 792/1598] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.709450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.719772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea8a5-7d5f-4370-b6b0-5c626866f5fb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.724302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.724934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.725220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.725498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.726929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.728871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.735757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 807/1599] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/3f7ea2daaa864df7973b21d1d13ae47a/users/47da4644803547869a303a039ee7a28c/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:21.737078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.737398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.737676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.758938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:21.760186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:21.813203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 793/1600] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:21.814082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.820619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 808/1601] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:21.821496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.828728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54415f-6cee-4945-a5f6-317816796b87 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.831489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f87bf-04fb-4cd1-b3f3-891c35f5f0df None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.834292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.834969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.835256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.835532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.836257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.836384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.837020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.837304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.837636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] PATH_INFO: `/v3/projects/6bcd2b3241464b25a20c9d559ed9a049/users/14c4c1027d8a42c081d69fa821216675/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.838059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.849632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 794/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:21.850132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.858348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcd2b3241464b25a20c9d559ed9a049, user_id=14c4c1027d8a42c081d69fa821216675, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.861815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19dd71-8043-4f23-a7df-9af55aa916ac admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:21.862238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.867386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:21.868142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.868422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.868698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] PATH_INFO: `/v3/projects/ebe0bff033bf40c3a5247c2e7ff24ce5/users/b668d9d211e44591ab2f862fef68817e/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.884148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe0bff033bf40c3a5247c2e7ff24ce5, user_id=b668d9d211e44591ab2f862fef68817e, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:21.887021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:21.922102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 809/1603] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/6bcd2b3241464b25a20c9d559ed9a049/users/14c4c1027d8a42c081d69fa821216675/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:21.922908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.940111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:21.945510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 795/1604] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/ebe0bff033bf40c3a5247c2e7ff24ce5/users/b668d9d211e44591ab2f862fef68817e/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:21.956945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:21.987112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc150-b7e7-4d41-bc00-3a9afcf72243 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.010383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b97b-326c-4227-b409-9bab5988c16e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.015836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.015954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.016215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.016505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.016787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] PATH_INFO: `/v3/projects/99f226fd34d040b9aec6bebb4a597c9f/users/8e60b0e1ed5d462bb872021df057b8e7/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.031667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f226fd34d040b9aec6bebb4a597c9f, user_id=8e60b0e1ed5d462bb872021df057b8e7, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.034364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda61008-9cb5-40e5-9616-bbc237e55609 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.043224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.043902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.044188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.044465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] PATH_INFO: `/v3/projects/6795d79d849b44fc8f4e1d1621d6963a/users/fc68af6a40024ec0a4e4a729a16a5735/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.060698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6795d79d849b44fc8f4e1d1621d6963a, user_id=fc68af6a40024ec0a4e4a729a16a5735, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.063412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.101898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 796/1605] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/99f226fd34d040b9aec6bebb4a597c9f/users/8e60b0e1ed5d462bb872021df057b8e7/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:22.103451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.103781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.104067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.123512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.124735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.159902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 810/1606] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:21 2022] PUT /identity/v3/projects/6795d79d849b44fc8f4e1d1621d6963a/users/fc68af6a40024ec0a4e4a729a16a5735/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:22.161331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.200130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 797/1607] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.201300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.202617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.243456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a77fd-eea5-4eff-8b4d-3d72e64a0535 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.248972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.249606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.249923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.250182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.250884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.252493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.263468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 811/1608] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:22.263701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c04c-ed0d-4016-98ca-a85c2be46b1a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.264155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.277666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125e2b-5076-4c63-a014-728dbb17cb28 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.282603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.283321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.283603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.283879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] PATH_INFO: `/v3/projects/f351a73d1a584b2e9f51c4a86dfff0e3/users/ea98d747777d42a5a9192dd2c4746038/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.303809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.306758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f351a73d1a584b2e9f51c4a86dfff0e3, user_id=ea98d747777d42a5a9192dd2c4746038, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.309491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb9cb-e59a-4d60-a7d4-1c3eedd95903 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.320852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.321511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.321840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.322126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.332406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.333926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2eead-a76e-4e87-9ce5-98cb3090d7b7 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.345255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 798/1609] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:22.346605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19859f6-f29a-4f6d-a3e6-a21462097f5f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.346901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19859f6-f29a-4f6d-a3e6-a21462097f5f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.347186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19859f6-f29a-4f6d-a3e6-a21462097f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.369251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f19859f6-f29a-4f6d-a3e6-a21462097f5f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.370815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f19859f6-f29a-4f6d-a3e6-a21462097f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.378956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 799/1610] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.380264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd67e-574a-4f12-b1b5-2177a708cb73 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.380559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd67e-574a-4f12-b1b5-2177a708cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.380840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd67e-574a-4f12-b1b5-2177a708cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.411082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 812/1611] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:22 2022] PUT /identity/v3/projects/f351a73d1a584b2e9f51c4a86dfff0e3/users/ea98d747777d42a5a9192dd2c4746038/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:22.412574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-95efd67e-574a-4f12-b1b5-2177a708cb73 None None] MFA Rules not processed for user `b668d9d211e44591ab2f862fef68817e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.414019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.414019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.414594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.414820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-95efd67e-574a-4f12-b1b5-2177a708cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.455726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] MFA Rules not processed for user `8e60b0e1ed5d462bb872021df057b8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.457297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.509555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 800/1612] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.511259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.511547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.511824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.547119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 813/1613] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.548026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.551758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] MFA Rules not processed for user `fc68af6a40024ec0a4e4a729a16a5735`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.552993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.567589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.613260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aaeaa-1652-4ea2-a1c8-fc8a7b467d0e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.617114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.617738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.618053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.618329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.627121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 801/1614] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.627979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.693265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:22.698398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.699939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.712824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 814/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:22.713029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.717118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a351-17c2-46f6-b626-e7c4654e9c20 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.727953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d735b-81cd-40bf-b7b1-fb60c71bda74 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.728148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.728148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.728148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.728148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] PATH_INFO: `/v3/projects/9efa0526dfd244858d98d45051f612c3/users/5052d9eb468f4eeebf5be5e1ba4c7c98/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.729209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.729910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.730170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.730445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.740854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.743352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda1423-a049-4247-8931-c6779f7f61af service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.751903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efa0526dfd244858d98d45051f612c3, user_id=5052d9eb468f4eeebf5be5e1ba4c7c98, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.754755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 815/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:22.760745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.760887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ec4f-2f39-410e-96a8-5a4b24948091 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.760887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ec4f-2f39-410e-96a8-5a4b24948091 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.760887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556ec4f-2f39-410e-96a8-5a4b24948091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3556ec4f-2f39-410e-96a8-5a4b24948091 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3556ec4f-2f39-410e-96a8-5a4b24948091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 816/1617] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0d73-cc80-43e7-aef6-ce8f2a62f16b None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0d73-cc80-43e7-aef6-ce8f2a62f16b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.848697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0d73-cc80-43e7-aef6-ce8f2a62f16b None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.849829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 817/1618] 10.222.0.49 () {54 vars in 962 bytes} [Mon Aug 1 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:22.849829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0d73-cc80-43e7-aef6-ce8f2a62f16b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.849829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0d73-cc80-43e7-aef6-ce8f2a62f16b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.849829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.850334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.850334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.850334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.850334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.850334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec796c-0670-4175-9e04-61a2d03d46a5 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.889844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 802/1619] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:22 2022] PUT /identity/v3/projects/9efa0526dfd244858d98d45051f612c3/users/5052d9eb468f4eeebf5be5e1ba4c7c98/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:22.890854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.955259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 818/1620] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:22.958670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.959159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.959467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.983729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47fdf-dad0-442a-9ffe-950543e52dad admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.030331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:23.034300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:23.074489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.075144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.075456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.076054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.076749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.078825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.109971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:23.121022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 819/1621] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:23.122697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.177730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aed85-a7b7-48e3-ae21-a80829867feb None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.184503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.187511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.187511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.187511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.200667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.204183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.214382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 820/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:23.216128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.221457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 803/1623] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:22 2022] POST /identity/v3/projects => generated 373 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:23.223185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.233319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918781c-cbee-4166-9ce9-de2bb7e74a9d service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.311567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08dfb9-ec9e-4e70-908b-70170d7dec26 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.318047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.324160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.324160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.324160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.324160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.324499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.324613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.324702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.324933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.325400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.326320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.328138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.339666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 821/1624] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:23.340704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.440728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:23.453023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 804/1625] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:23 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:23.453023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.463121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae773338-50bf-4709-b51c-43920fa6eef7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.464165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837f557-c7ac-46d4-8ba6-845b0c2fa4bd admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.469062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.471608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.472528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.472528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.473475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.475395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.476470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.477890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.478989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.479844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.521273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:23.556057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.558996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.589017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 805/1626] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:23 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:23.590129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 822/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:23.590887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.593205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.616092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9051ee-66a5-4489-a0ce-20307e95b8a1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.627376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.628854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.629488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.630154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387e22-0501-4faa-89b5-1fe9f5ed029f service nova] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.630434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] PATH_INFO: `/v3/projects/9efa0526dfd244858d98d45051f612c3/users/5052d9eb468f4eeebf5be5e1ba4c7c98/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.638155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efa0526dfd244858d98d45051f612c3, user_id=5052d9eb468f4eeebf5be5e1ba4c7c98, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.648516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.648516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.648708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.648821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.648821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.648821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.650233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.666314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 823/1628] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:23.667673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.682390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 806/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:23 2022] PUT /identity/v3/projects/9efa0526dfd244858d98d45051f612c3/users/5052d9eb468f4eeebf5be5e1ba4c7c98/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:23.683398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:23.691359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa640d-50e1-4fc1-b46d-d7ffaca89bb1 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.829086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.830781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.831072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.831416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.832128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.836159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d493a79-a0f7-4e40-9982-ad084caa00cd admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:23.870808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 824/1630] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:23.877520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.878306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.878739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.890151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a28-75d6-446e-a069-32a758aefcfb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:23.924741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:23.925466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:23.925776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:23.926056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] PATH_INFO: `/v3/projects/8090a8e86c484ceb8d2982feccaa605c/users/8af4bacc1a1c444d90de6f380d12ca56/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:23.959292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] MFA Rules not processed for user `5052d9eb468f4eeebf5be5e1ba4c7c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:23.963360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:23.965263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8090a8e86c484ceb8d2982feccaa605c, user_id=8af4bacc1a1c444d90de6f380d12ca56, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:23.968244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca05db3-6a87-4005-be8c-50c1aef37cfa admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.080139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 825/1631] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:24.080139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.080476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 807/1632] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:23 2022] PUT /identity/v3/projects/8090a8e86c484ceb8d2982feccaa605c/users/8af4bacc1a1c444d90de6f380d12ca56/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:24.081207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b787-3ee3-4f14-822a-21e62567b401 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.081588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b787-3ee3-4f14-822a-21e62567b401 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.081980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b787-3ee3-4f14-822a-21e62567b401 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.086047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 808/1633] 10.222.0.49 () {54 vars in 912 bytes} [Mon Aug 1 14:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:24.095617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094b9f-a772-4535-997e-2e670b9c2776 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.095943 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b787-3ee3-4f14-822a-21e62567b401 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.158317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:24.175379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.176136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.176430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.176722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] PATH_INFO: `/v3/projects/636a376c418c4c22a2d5c478952f1b29/users/c0cbe0165e7e450faba6923b32366369/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.199144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636a376c418c4c22a2d5c478952f1b29, user_id=c0cbe0165e7e450faba6923b32366369, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.202273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63fab5-48f7-498c-9dbb-d983a991fe88 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.262913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b787-3ee3-4f14-822a-21e62567b401 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.269988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.270729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.271022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.271844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.272648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.275262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.301620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 809/1634] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:24.302574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.330149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 826/1635] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:24 2022] PUT /identity/v3/projects/636a376c418c4c22a2d5c478952f1b29/users/c0cbe0165e7e450faba6923b32366369/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:24.333025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.333654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.334503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.376055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:24.376627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:24.378120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:24.382673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e71582-8c14-453d-bea5-5b46b7f7cd53 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.439153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.439806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.440095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.440370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.511215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 827/1636] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:24.512422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.543032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.544678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.574371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 810/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:24.576744 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.611967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702e9dd-d838-4f54-889b-32bd6b279fd5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.619968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.622607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.623264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.626006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] PATH_INFO: `/v3/projects/8090a8e86c484ceb8d2982feccaa605c/users/8af4bacc1a1c444d90de6f380d12ca56/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.630268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8090a8e86c484ceb8d2982feccaa605c, user_id=8af4bacc1a1c444d90de6f380d12ca56, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.635299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.664477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94358241-177d-4387-9ac2-c5fcec08908f service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.681046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 828/1638] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:24 2022] PUT /identity/v3/projects/8090a8e86c484ceb8d2982feccaa605c/users/8af4bacc1a1c444d90de6f380d12ca56/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:24.682699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:24.803497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.806083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.807572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.808099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.808846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.824443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c3245-9c92-436b-9edd-921310f0f2d0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.847381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50cec3-5123-4a8a-a6e5-79385d7a6859 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:24.847766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 811/1639] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:24.849188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.849622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.849963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.860747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:24.861714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:24.866113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:24.866113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:24.874678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:24.883765 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] MFA Rules not processed for user `8af4bacc1a1c444d90de6f380d12ca56`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:24.885118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:24.971237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:24.973164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:24.998301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 829/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:24.999264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:25.012044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:25.032502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43ccf-f00b-4c80-97d8-cbb2cdc83e7d service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:25.045266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:25.045950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:25.046234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:25.046512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] PATH_INFO: `/v3/projects/636a376c418c4c22a2d5c478952f1b29/users/c0cbe0165e7e450faba6923b32366369/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:25.055253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636a376c418c4c22a2d5c478952f1b29, user_id=c0cbe0165e7e450faba6923b32366369, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:25.057583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26d0ef-bbff-48c0-9715-b18c073cd1c5 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:25.066643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 812/1641] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:25.067618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:25.079202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 830/1642] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:24 2022] PUT /identity/v3/projects/636a376c418c4c22a2d5c478952f1b29/users/c0cbe0165e7e450faba6923b32366369/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:25.087076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa02808-07f6-4e86-9c83-8b042234d073 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:25.099551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:25.099551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:25.099551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:25.166321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:25.167810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:25.168343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:25.168785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:25.203961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] MFA Rules not processed for user `c0cbe0165e7e450faba6923b32366369`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:25.204761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:25.260640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:25.262875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:25.275555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 813/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:25.396314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 831/1644] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:26.016470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:26.030163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bbc05-c4ce-4e4f-9450-5919d394e1d4 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:26.034975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:26.036055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:26.036506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:26.037116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:26.192033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.192033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:26.192033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:26.192033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 814/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:26.477691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:26.494803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52fb0-0650-4adc-9746-b1a228b1e9dd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:26.503058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:26.504062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:26.504600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:26.505059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:26.530957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:26.532801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee301ea4-400c-425e-b0cb-e26a54d4e12a service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:26.550919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 832/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:27.075856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:27.091738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295d46-0bc9-4405-b4c3-0a4871086e6a service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:27.105976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:27.112529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:27.112529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:27.112529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:27.307952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:27.310274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50369e9-9ebc-45f7-9fc0-38690d0c58ca service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:27.332438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 815/1647] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:27.463117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca29c-17c8-4db3-980a-542d4fdb9ff9 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:27.463248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca29c-17c8-4db3-980a-542d4fdb9ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:27.463469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca29c-17c8-4db3-980a-542d4fdb9ff9 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:27.470118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 833/1648] 10.222.0.49 () {54 vars in 962 bytes} [Mon Aug 1 14:20:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:27.492338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e0fd-77b4-4403-9e07-b61d9d4a1fb1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:27.494301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e0fd-77b4-4403-9e07-b61d9d4a1fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:27.494697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e0fd-77b4-4403-9e07-b61d9d4a1fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:27.528282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ad72e0fd-77b4-4403-9e07-b61d9d4a1fb1 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:27.531843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ad72e0fd-77b4-4403-9e07-b61d9d4a1fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:27.764416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 816/1649] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Aug 1 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:27.772501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261db-efbb-43be-a804-9dfee226d28f None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:27.773028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261db-efbb-43be-a804-9dfee226d28f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:27.773262 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca261db-efbb-43be-a804-9dfee226d28f None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:27.777449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 834/1650] 10.222.0.49 () {54 vars in 912 bytes} [Mon Aug 1 14:20:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:27.797121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:27.801520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:27.801520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:27.845797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:27.848430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:27.869088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 817/1651] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:20:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:27.977537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca261db-efbb-43be-a804-9dfee226d28f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:28.026460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca261db-efbb-43be-a804-9dfee226d28f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:28.049676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:28.050433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:28.050722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:28.051001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:28.127665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:28.130434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1df9e-2a1a-45a2-9786-b4c72ef5f275 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:28.170118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 835/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:29.264054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:29.441033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:29.533711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c706f-0483-4ac1-a829-0fb6e60881ed None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:29.576587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:29.577280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:29.577556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:29.578038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] PATH_INFO: `/v3/users/fc68af6a40024ec0a4e4a729a16a5735` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:29.582005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc68af6a40024ec0a4e4a729a16a5735)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:29.584016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:29.979695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc68af6a40024ec0a4e4a729a16a5735'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:29.981521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc68af6a40024ec0a4e4a729a16a5735'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:30.029861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc68af6a40024ec0a4e4a729a16a5735'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:30.031683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc68af6a40024ec0a4e4a729a16a5735'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:30.141702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc68af6a40024ec0a4e4a729a16a5735'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:30.180671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 818/1653] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:29 2022] DELETE /identity/v3/users/fc68af6a40024ec0a4e4a729a16a5735 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:30.181050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:30.181515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:30.181819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:30.235303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:30.235303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:30.303250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:30.337590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 836/1654] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:30.348385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:30.350103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:30.525348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa5ec-f642-46f2-9ac0-c0e4e12e546d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:30.535945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:30.536607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:30.536899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:30.537183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:30.563353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:30.567414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:30.615428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 819/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:31.424644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:31.426831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:31.469643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb878b5-b1c1-4533-9084-321ad55f0e1b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:31.500662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:31.501234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:31.501729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:31.502185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] PATH_INFO: `/v3/users/d706df932ec748539d250c64f729c44e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:31.503739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d706df932ec748539d250c64f729c44e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:31.508297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: WARNING py.warnings [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:31.508297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: warnings.warn(msg) Aug 01 14:20:31.508297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: Aug 01 14:20:31.510234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:31.908673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd706df932ec748539d250c64f729c44e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:31.909732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd706df932ec748539d250c64f729c44e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:31.950506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd706df932ec748539d250c64f729c44e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:31.963530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd706df932ec748539d250c64f729c44e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.006996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:32.009967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:32.040833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9febc-628d-438a-8f42-8124fde3a293 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:32.047141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:32.048033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:32.048542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:32.049143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] PATH_INFO: `/v3/projects/6795d79d849b44fc8f4e1d1621d6963a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:32.050776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6795d79d849b44fc8f4e1d1621d6963a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:32.052162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:20:32.052162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Aug 01 14:20:32.052162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: Aug 01 14:20:32.053890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:32.087926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ae4c7b15-d6ea-4671-81f5-f9947f593838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd706df932ec748539d250c64f729c44e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.096861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 837/1656] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:31 2022] DELETE /identity/v3/users/d706df932ec748539d250c64f729c44e => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:32.102079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:32.102567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:32.103005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:32.153232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:32.154624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:32.286493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6795d79d849b44fc8f4e1d1621d6963a', 'request_id': 'req-2344d82f-a52f-4b9b-932c-609eb8fd5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.303746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6795d79d849b44fc8f4e1d1621d6963a', 'request_id': 'req-2344d82f-a52f-4b9b-932c-609eb8fd5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.330458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6795d79d849b44fc8f4e1d1621d6963a', 'request_id': 'req-2344d82f-a52f-4b9b-932c-609eb8fd5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.345451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 838/1657] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:32.357047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:32.361441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:32.409730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:32.418144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] The token cache is being invalidate because project 6795d79d849b44fc8f4e1d1621d6963a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:32.418446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.421815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:32.429467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 820/1658] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:32 2022] DELETE /identity/v3/projects/6795d79d849b44fc8f4e1d1621d6963a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:32.433464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:32.436211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:32.518430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80ab0c-da12-4aae-9de4-6cdd83c8f413 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:32.551997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:32.660276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344d82f-a52f-4b9b-932c-609eb8fd5c65 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:32.701052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:32.702067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:32.702357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:32.703710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] PATH_INFO: `/v3/users/c0cbe0165e7e450faba6923b32366369` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:32.708656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cbe0165e7e450faba6923b32366369)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:32.719046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:32.720173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:32.720616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:32.721031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:32.721479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:32.725263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:32.763205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:32.765871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:32.778530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 839/1659] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:33.064687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cbe0165e7e450faba6923b32366369'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:33.068523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cbe0165e7e450faba6923b32366369'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:33.102426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cbe0165e7e450faba6923b32366369'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:33.105677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cbe0165e7e450faba6923b32366369'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:33.180193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ed25607e-0c93-464b-b500-21a92d4ddcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cbe0165e7e450faba6923b32366369'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:33.204158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 821/1660] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:32 2022] DELETE /identity/v3/users/c0cbe0165e7e450faba6923b32366369 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:34.187748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:34.242439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95266f18-dfe9-4cf2-887b-83609a2f7545 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:34.364304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:34.365034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:34.365327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:34.365604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] PATH_INFO: `/v3/projects/636a376c418c4c22a2d5c478952f1b29` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:34.369899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=636a376c418c4c22a2d5c478952f1b29)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:34.372225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:34.550630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636a376c418c4c22a2d5c478952f1b29', 'request_id': 'req-e3eed819-320a-4b4a-b31e-855a20c732ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:34.562141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636a376c418c4c22a2d5c478952f1b29', 'request_id': 'req-e3eed819-320a-4b4a-b31e-855a20c732ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:34.572936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636a376c418c4c22a2d5c478952f1b29', 'request_id': 'req-e3eed819-320a-4b4a-b31e-855a20c732ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:34.721703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] The token cache is being invalidate because project 636a376c418c4c22a2d5c478952f1b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:34.722028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:34.727141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e3eed819-320a-4b4a-b31e-855a20c732ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:34.732958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 840/1661] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:34 2022] DELETE /identity/v3/projects/636a376c418c4c22a2d5c478952f1b29 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:34.738200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:34.739115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:34.739611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:34.785938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:34.788804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:34.931925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 822/1662] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:34.942515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:34.942515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:34.942515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:34.969114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:34.972233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:34.983426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 841/1663] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:34.987594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.013524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331452-0ced-4c1d-bf98-72297e54de64 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.032871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.041520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.042137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.043297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.050591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:35.050927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.055326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.075331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 823/1664] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:35.078014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.093437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b829f-48e0-4471-874a-772698b0b564 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.103441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.105447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.105447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.105447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.118695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.136758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.136972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.139250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:35.161240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:35.168309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e1-2286-41c5-bcda-1d5423f6abb4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.178375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.180466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.181637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.183897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] PATH_INFO: `/v3/projects/bc42d81a7cfc4d7680da35485637950e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.188205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc42d81a7cfc4d7680da35485637950e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.195024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.292158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 842/1665] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:35 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:35.299190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.362255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:35.434461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc42d81a7cfc4d7680da35485637950e', 'request_id': 'req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:35.444718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc42d81a7cfc4d7680da35485637950e', 'request_id': 'req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:35.456051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc42d81a7cfc4d7680da35485637950e', 'request_id': 'req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:35.563525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e688-c7c8-428f-a1cb-082220aee464 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.589486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] The token cache is being invalidate because project bc42d81a7cfc4d7680da35485637950e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:35.591373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:35.593315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:35.601859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 824/1666] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:35 2022] DELETE /identity/v3/projects/bc42d81a7cfc4d7680da35485637950e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:35.603144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.604930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:35.740871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.742097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.742390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.742675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.743374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.745661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.754792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98ed52-c971-44a8-8f31-6bcfb9d45f19 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.788175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.790034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.790034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.790337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] PATH_INFO: `/v3/users/5052d9eb468f4eeebf5be5e1ba4c7c98` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.793536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5052d9eb468f4eeebf5be5e1ba4c7c98)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.800644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.887287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 843/1667] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:35 2022] POST /identity/v3/users => generated 283 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:35.892458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.894998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:35.909207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d9fb5-5644-4dcb-8752-a2441dfa9d1d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:35.918322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:35.919329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:35.919765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:35.920228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:35.921331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:35.923484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:35.941430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 844/1668] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:35.946628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:35.989955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c5e37-28ff-4d42-9f43-21fef3ff31fa admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:36.002766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:36.003718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:36.004150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:36.004584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:36.005432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:36.007900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:36.034495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 845/1669] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:36.038859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:36.054249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e070b-d603-4183-8c92-e0ebc0a20bf4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:36.061282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:36.063788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:36.063788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:36.063788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] PATH_INFO: `/v3/projects/99a11609315f453d89d0bfb7d1db9581/users/67e8d9e70b184b4e9621b3f4bb177e9b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:36.108708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a11609315f453d89d0bfb7d1db9581, user_id=67e8d9e70b184b4e9621b3f4bb177e9b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:36.114056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5052d9eb468f4eeebf5be5e1ba4c7c98'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:36.114056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5052d9eb468f4eeebf5be5e1ba4c7c98'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:36.119389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86382bc8-1c3f-4494-8fe0-7697ab674c22 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:36.146736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5052d9eb468f4eeebf5be5e1ba4c7c98'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:36.148091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5052d9eb468f4eeebf5be5e1ba4c7c98'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:36.244903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5052d9eb468f4eeebf5be5e1ba4c7c98'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:36.302636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 846/1670] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:36 2022] PUT /identity/v3/projects/99a11609315f453d89d0bfb7d1db9581/users/67e8d9e70b184b4e9621b3f4bb177e9b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:36.315460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:36.315944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:36.316434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:36.360300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 825/1671] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:35 2022] DELETE /identity/v3/users/5052d9eb468f4eeebf5be5e1ba4c7c98 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:36.458155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] MFA Rules not processed for user `67e8d9e70b184b4e9621b3f4bb177e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:36.458155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:36.714446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 847/1672] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:36.719129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:36.721833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:36.897307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997286e0-f83a-48e4-9c00-66178cf090ce admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:36.911102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:36.911885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:36.912230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:36.912736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:36.914706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:36.920996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a9a15-9d8b-4a6a-89b3-408d0a21d24c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:37.088080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 826/1673] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:36 2022] POST /identity/v3/projects => generated 365 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:37.091837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:37.114333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb159-489b-4a1c-8b43-0aaa4472aa10 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.114333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb159-489b-4a1c-8b43-0aaa4472aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.114333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb159-489b-4a1c-8b43-0aaa4472aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.119884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191042b3-6e4e-451a-9bb7-13ff1fd4f42c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:37.167087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7d4eb159-489b-4a1c-8b43-0aaa4472aa10 None None] MFA Rules not processed for user `ea98d747777d42a5a9192dd2c4746038`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:37.168544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7d4eb159-489b-4a1c-8b43-0aaa4472aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:37.231618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:37.232489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.233430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.234808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.246346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:37.259909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:37.263366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:37.386230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 827/1674] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:37.399320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.399825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.402150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.426520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 848/1675] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:37 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:37.427821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:37.450489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b236c5-dbab-411a-ab34-8b9b6d276a00 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:37.463505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:37.465146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.465146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.465146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.466157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:37.467661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] MFA Rules not processed for user `ea98d747777d42a5a9192dd2c4746038`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:37.468396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:37.469866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:37.489068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 828/1676] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:37.501106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:37.502931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:37.503997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 849/1677] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:37.508637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:37.530480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0f10c-03f1-4c45-8014-9c64f5220abe admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:37.534690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:37.544470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:37.561158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.562931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.563220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] PATH_INFO: `/v3/projects/61dda2bd091043909466e23968f58ca3/users/0d78175074ab4e50a175305e2ee37c6a/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.634566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dda2bd091043909466e23968f58ca3, user_id=0d78175074ab4e50a175305e2ee37c6a, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:37.643969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:37.744598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 850/1678] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:37 2022] PUT /identity/v3/projects/61dda2bd091043909466e23968f58ca3/users/0d78175074ab4e50a175305e2ee37c6a/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:37.749432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:37.787176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef55c-c8a3-469e-a1f9-398101960070 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:37.968716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afb9-68f2-4bfe-82f3-aef46f2c33bf admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:37.986972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:37.986972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.986972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.986972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:37.987414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:37.988216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:37.993423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:37.994452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:37.994452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:37.994860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.015433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 851/1679] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:38.016375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:38.020140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:38.049935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d62f3-91f1-4162-af61-941715f61048 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:38.064498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:38.064498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.064498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.064498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] PATH_INFO: `/v3/projects/9efa0526dfd244858d98d45051f612c3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.066074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efa0526dfd244858d98d45051f612c3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:38.068137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:38.129463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:38.131178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:38.154262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 829/1680] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:20:38.155364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:38.169102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d236-3065-4321-9cd4-43c247fa7b8c service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:38.174375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:38.175180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.175526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.175820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] PATH_INFO: `/v3/projects/61dda2bd091043909466e23968f58ca3/users/0d78175074ab4e50a175305e2ee37c6a/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.178087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dda2bd091043909466e23968f58ca3, user_id=0d78175074ab4e50a175305e2ee37c6a, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:38.190655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39023453-eff2-48e3-8662-46ab1da3585a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:38.218792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 830/1681] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:38 2022] PUT /identity/v3/projects/61dda2bd091043909466e23968f58ca3/users/0d78175074ab4e50a175305e2ee37c6a/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:38.240259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.243850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.243850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.270265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efa0526dfd244858d98d45051f612c3', 'request_id': 'req-e0c823f3-97c4-4303-b3bb-182ac45ccfec'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:38.288886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efa0526dfd244858d98d45051f612c3', 'request_id': 'req-e0c823f3-97c4-4303-b3bb-182ac45ccfec'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:38.308045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efa0526dfd244858d98d45051f612c3', 'request_id': 'req-e0c823f3-97c4-4303-b3bb-182ac45ccfec'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:38.319005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] MFA Rules not processed for user `0d78175074ab4e50a175305e2ee37c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:38.320536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:38.391026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] The token cache is being invalidate because project 9efa0526dfd244858d98d45051f612c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:38.391690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:38.393215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c823f3-97c4-4303-b3bb-182ac45ccfec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:38.395799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 852/1682] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:38 2022] DELETE /identity/v3/projects/9efa0526dfd244858d98d45051f612c3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:38.402542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a339-5a61-494a-aeca-0342c86e3a4a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.402840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a339-5a61-494a-aeca-0342c86e3a4a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.403119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a339-5a61-494a-aeca-0342c86e3a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.454731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1b41a339-5a61-494a-aeca-0342c86e3a4a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:38.468081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1b41a339-5a61-494a-aeca-0342c86e3a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:38.560997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 831/1683] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:38.585725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:38.591293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:38.608599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:38.700033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 853/1684] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:38.709801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.710835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.711238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.744158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:38.746492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:38.774482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 854/1685] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:38.781379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:38.795155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c090-6b06-4a91-94ba-5279a2eece96 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:38.797421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61812e-f099-43ab-b0d6-e1db7b0adcd2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:38.807315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:38.808490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.808729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.809172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.816033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:38.816825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:38.819858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:38.822588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:38.832645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:38.847237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:38.847237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:38.874859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:38.877260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:38.885635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299b85-19a6-43c0-8191-c7bceac56db2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:38.900836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 832/1686] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:38.995432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.002985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 855/1687] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:39.018845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a9dfe-48c2-4d10-9f42-e97416ea430c service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.046141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.046141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.046141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.046141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.046523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.071530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:39.181417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcd76-369f-4015-849c-dae1ad1c2146 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.181975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcd76-369f-4015-849c-dae1ad1c2146 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.182516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcd76-369f-4015-849c-dae1ad1c2146 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.185703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 856/1688] 10.222.0.49 () {54 vars in 912 bytes} [Mon Aug 1 14:20:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:39.209979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.209979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.209979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.306704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 833/1689] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:38 2022] POST /identity/v3/projects => generated 367 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:20:39.312812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.313983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:39.318735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:39.460600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9494908-c430-49c6-a3fc-d2c4d8ecd7c8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.479106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 857/1690] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:20:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:39.484369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.484369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.484369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.484369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.485043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.493446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.496424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:39.502099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:39.524079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939bd86-820f-4538-a9cb-c518b1d2a417 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.533049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.534273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.535928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.535928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.554900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.556964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:39.582669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 858/1691] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:39.644054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:39.660340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 834/1692] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:39 2022] POST /identity/v3/users => generated 284 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:39.660660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.689483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2671-5ded-482c-b95c-800b4db04f12 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.713959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.714680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.714970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.715487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.716259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.720122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:39.767752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 859/1693] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:20:39.771616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.789500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458236c1-9d20-4f6e-ae7e-9f7799c5ea2e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.812952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.813858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.814153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.814472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.815191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.817009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd8061-3143-47da-b2e4-18a6e2498277 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:39.839415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:39.844998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 835/1694] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:39.853421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024854d2-866c-4e8a-995e-dc1ad2b39321 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:39.865430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:39.868972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:39.871046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:39.871046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] PATH_INFO: `/v3/projects/b8127b6913b1470093db2173dd2dd5b9/users/eb0629ab5acd41dbbe054ef8b0be007a/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:39.895711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8127b6913b1470093db2173dd2dd5b9, user_id=eb0629ab5acd41dbbe054ef8b0be007a, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:39.911068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cf584-38ce-4f19-9a01-197a252ab6c6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:40.031812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e02b8-5ec2-4d7e-b284-787cd3e5433f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.038533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e02b8-5ec2-4d7e-b284-787cd3e5433f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.038533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e02b8-5ec2-4d7e-b284-787cd3e5433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.067018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:40.092135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 860/1695] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:39 2022] PUT /identity/v3/projects/b8127b6913b1470093db2173dd2dd5b9/users/eb0629ab5acd41dbbe054ef8b0be007a/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:40.092135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef274c-012f-4465-8a7c-9fc441cc3c9b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.092135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef274c-012f-4465-8a7c-9fc441cc3c9b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.092135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef274c-012f-4465-8a7c-9fc441cc3c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.119498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cd1e02b8-5ec2-4d7e-b284-787cd3e5433f None None] MFA Rules not processed for user `6b46ac5a29594c41a83e70838b0a13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:40.123357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cd1e02b8-5ec2-4d7e-b284-787cd3e5433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.158998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b6ef274c-012f-4465-8a7c-9fc441cc3c9b None None] MFA Rules not processed for user `14c4c1027d8a42c081d69fa821216675`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:40.161341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b6ef274c-012f-4465-8a7c-9fc441cc3c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.353072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 836/1696] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:40.355485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.355787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.356074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.365677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 861/1697] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:40.375235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.375235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.375235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.398291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] MFA Rules not processed for user `6b46ac5a29594c41a83e70838b0a13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:40.409228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.427018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 862/1698] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:40.429560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:40.431474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.452905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] MFA Rules not processed for user `eb0629ab5acd41dbbe054ef8b0be007a`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:40.457250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.541145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca8498-b7fb-4724-aa8b-ed7137deb411 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:40.549314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:40.550709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.551151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.551599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.587188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:40.589558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:40.615391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 863/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:40.642026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 837/1700] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:40.649255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:40.682641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:40.775818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f762c2-0f0f-4552-8520-999afa6cfa20 service nova] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:40.783222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:40.784152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:40.785204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:40.785494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:40.786652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:40.798367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:40.886596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:40.895125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:40.973996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 864/1701] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/projects => generated 367 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:40.979795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:40.988901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3c5d-d4ed-4db4-b464-f679d7613dec None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:41.101339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:41.106267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.106267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.106267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] PATH_INFO: `/v3/users/67e8d9e70b184b4e9621b3f4bb177e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.107775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e8d9e70b184b4e9621b3f4bb177e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:41.124928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:41.149673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b4de4-75fe-4f14-b980-f8e3cc726418 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:41.159430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:41.160073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.160438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.160887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.161714 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:41.164334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:41.313022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 865/1702] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:40 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:41.313022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:41.314982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:41.340455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f70a6-3b38-4fa0-ab5f-3ead896fd246 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:41.346847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:41.347753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.348113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.348403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] PATH_INFO: `/v3/users/b668d9d211e44591ab2f862fef68817e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.351138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b668d9d211e44591ab2f862fef68817e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:41.363976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:41.464453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e8d9e70b184b4e9621b3f4bb177e9b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.465280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e8d9e70b184b4e9621b3f4bb177e9b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.493657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:41.497377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e8d9e70b184b4e9621b3f4bb177e9b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.497377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e8d9e70b184b4e9621b3f4bb177e9b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.597667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9fa8ffe4-018e-4aed-9c05-0a0ac335a076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e8d9e70b184b4e9621b3f4bb177e9b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.615633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 838/1703] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:40 2022] DELETE /identity/v3/users/67e8d9e70b184b4e9621b3f4bb177e9b => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:41.618239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.618543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.618977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.629435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 839/1704] 10.222.0.49 () {54 vars in 961 bytes} [Mon Aug 1 14:20:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:41.630504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:41.632045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b668d9d211e44591ab2f862fef68817e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.633531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:41.634216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b668d9d211e44591ab2f862fef68817e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.692639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:41.707782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b668d9d211e44591ab2f862fef68817e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.746933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b668d9d211e44591ab2f862fef68817e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.834147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c95e-2990-477d-a45a-fab9731279e6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:41.837710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e2af054c-1d08-4db4-8f38-67cb03df55f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b668d9d211e44591ab2f862fef68817e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:41.844806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:41.846611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.846906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.847187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.847484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 866/1705] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:41 2022] DELETE /identity/v3/users/b668d9d211e44591ab2f862fef68817e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:41.849008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb803a2-f0f0-4550-a4d7-2234e3981699 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:41.850237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb803a2-f0f0-4550-a4d7-2234e3981699 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:41.851607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb803a2-f0f0-4550-a4d7-2234e3981699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:41.852407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:41.922976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:41.925256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:41.929187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1fb803a2-f0f0-4550-a4d7-2234e3981699 None None] MFA Rules not processed for user `47da4644803547869a303a039ee7a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:41.931781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1fb803a2-f0f0-4550-a4d7-2234e3981699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:41.969096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 840/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:41.969096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:41.969096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.127160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 867/1707] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:42.129052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f617-03d0-4728-ae80-2ffff7e96fab None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.133232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f617-03d0-4728-ae80-2ffff7e96fab None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.133232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f617-03d0-4728-ae80-2ffff7e96fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.136575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768416a-6abc-4bf5-8ada-c69fce4b98e3 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.157015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0366f617-03d0-4728-ae80-2ffff7e96fab None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:42.159057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0366f617-03d0-4728-ae80-2ffff7e96fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.220419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:42.244289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 868/1708] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:42.246548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.246992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.256073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.299232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:42.300273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.300860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.301295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.302230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:42.304902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:42.307243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29f58-6506-4679-96a0-61deaf7cfc07 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:42.308730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.330694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 841/1709] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:42.332100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.332395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.332679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.377734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:42.379417 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.417249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 842/1710] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:42.417249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:42.427720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.473664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 869/1711] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Aug 1 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:42.474951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:42.478014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.608513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe555f-9c77-432f-b74f-9ed6001f45c0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.623786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd9de-74c1-4bf9-88e4-46a0029707ee None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.626154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:42.626914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.628677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.628857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.632453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:42.633355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.636340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.636839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.651726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:42.653426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:42.682635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:42.688554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 843/1712] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:42.689989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:42.690303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:42.718003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b6a1-03da-42be-9bf0-8123962eaf55 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.723028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 870/1713] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:42.725902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:42.726036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:42.727026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.727317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.727650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] PATH_INFO: `/v3/projects/1ead1ce4dfbc41848b370248959a5fcf/users/f64d4176070a4cea9ecee76eb4d2d076/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.730340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:42.762389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ead1ce4dfbc41848b370248959a5fcf, user_id=f64d4176070a4cea9ecee76eb4d2d076, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:42.762389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:42.768772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a801d-5a7e-4eda-9535-5acee6046436 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.775975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:42.776848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:42.777133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:42.788684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:42.813798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:42.820299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:42.848377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 871/1714] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:42.851076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:42.879038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a35e-d2c8-4742-8107-d47e4631ee8c service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:42.879780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 844/1715] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:42 2022] PUT /identity/v3/projects/1ead1ce4dfbc41848b370248959a5fcf/users/f64d4176070a4cea9ecee76eb4d2d076/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:42.880980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:43.069323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516cabf-4655-49fd-9be1-793ca5d1df27 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:43.081630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:43.082980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.084476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.086367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:43.088934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:43.092135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:43.103480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:43.104127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.104419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.104698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:43.110500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:43.133961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 845/1716] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:43.151087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:43.160574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:43.167117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782d4eb-8b0a-4406-a496-6bddbb1f21fa service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:43.176944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4c1a0-1d2c-43c4-945b-7a4e8a18b095 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:43.197896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 872/1717] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:43.204133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:43.204133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.204133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.204133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] PATH_INFO: `/v3/projects/1ead1ce4dfbc41848b370248959a5fcf/users/f64d4176070a4cea9ecee76eb4d2d076/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:43.205978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ead1ce4dfbc41848b370248959a5fcf, user_id=f64d4176070a4cea9ecee76eb4d2d076, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:43.212673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:43.240376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 846/1718] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:43 2022] PUT /identity/v3/projects/1ead1ce4dfbc41848b370248959a5fcf/users/f64d4176070a4cea9ecee76eb4d2d076/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:43.244528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1aa0-41b8-495b-93b0-9a2197ba9f87 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.244528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1aa0-41b8-495b-93b0-9a2197ba9f87 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.244528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1aa0-41b8-495b-93b0-9a2197ba9f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:43.353287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a7ef1aa0-41b8-495b-93b0-9a2197ba9f87 None None] MFA Rules not processed for user `f64d4176070a4cea9ecee76eb4d2d076`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:43.355184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a7ef1aa0-41b8-495b-93b0-9a2197ba9f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:43.555795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 873/1719] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:43.575188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:43.578576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:43.754064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030bc6-1c57-4c92-a7b6-83586357736a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:43.768033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:43.769020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.771234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.773389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:43.805640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:43.842122 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:43.850901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:43.894067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 847/1720] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:43.933342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:43.933905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:43.934266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:44.003418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] MFA Rules not processed for user `6b46ac5a29594c41a83e70838b0a13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:44.004675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:44.123715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 874/1721] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:44.135237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:44.162749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbd69a-94d4-4c7c-83b5-9bc92a0862ad service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:44.184706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:44.186114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:44.186407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:44.186692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:44.188755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:44.293782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:44.478816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:44.480516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:44.496912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 848/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:44.606574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:44.886097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:44.888170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:45.063786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9d8f9-dc8e-49f4-a762-c89f886b3c79 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:45.076098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:45.077035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:45.078328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:45.078832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] PATH_INFO: `/v3/projects/ebe0bff033bf40c3a5247c2e7ff24ce5` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:45.081378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe0bff033bf40c3a5247c2e7ff24ce5)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:45.086933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:45.141797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:45.145597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:45.148358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:45.183384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdb2e9-3a7f-4784-a91a-6587506351e7 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:45.195865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:45.196952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:45.198136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:45.198644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] PATH_INFO: `/v3/projects/99a11609315f453d89d0bfb7d1db9581` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:45.201834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a11609315f453d89d0bfb7d1db9581)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:45.204485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:45.361719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe0bff033bf40c3a5247c2e7ff24ce5', 'request_id': 'req-aa6cfc57-6e73-485f-8100-da014bd331d8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.370772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe0bff033bf40c3a5247c2e7ff24ce5', 'request_id': 'req-aa6cfc57-6e73-485f-8100-da014bd331d8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.377902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe0bff033bf40c3a5247c2e7ff24ce5', 'request_id': 'req-aa6cfc57-6e73-485f-8100-da014bd331d8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.442729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a11609315f453d89d0bfb7d1db9581', 'request_id': 'req-3762f16b-8916-417d-87a7-1c9325646d6c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.457695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a11609315f453d89d0bfb7d1db9581', 'request_id': 'req-3762f16b-8916-417d-87a7-1c9325646d6c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.472761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a11609315f453d89d0bfb7d1db9581', 'request_id': 'req-3762f16b-8916-417d-87a7-1c9325646d6c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.518247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] The token cache is being invalidate because project ebe0bff033bf40c3a5247c2e7ff24ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:45.518793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.519609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa6cfc57-6e73-485f-8100-da014bd331d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.523155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 875/1723] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:44 2022] DELETE /identity/v3/projects/ebe0bff033bf40c3a5247c2e7ff24ce5 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:45.528903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ba69-b140-46fe-af9f-e66ef89b95e6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:45.529339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ba69-b140-46fe-af9f-e66ef89b95e6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:45.530213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750ba69-b140-46fe-af9f-e66ef89b95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:45.573153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f750ba69-b140-46fe-af9f-e66ef89b95e6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:45.576037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f750ba69-b140-46fe-af9f-e66ef89b95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:45.635979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] The token cache is being invalidate because project 99a11609315f453d89d0bfb7d1db9581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:45.638614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.639647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:45.651491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 849/1724] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:45 2022] DELETE /identity/v3/projects/99a11609315f453d89d0bfb7d1db9581 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:45.700281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:45.708039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:45.875032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 876/1725] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:45.882031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:45.882031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:45.882031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:45.962045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:45.963366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:46.003025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f16b-8916-417d-87a7-1c9325646d6c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:46.014790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 877/1726] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:46.018766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:46.023450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:46.027314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:46.029432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:46.030513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] PATH_INFO: `/v3/users/0d78175074ab4e50a175305e2ee37c6a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:46.037163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d78175074ab4e50a175305e2ee37c6a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:46.041864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333dcbc-7439-42f3-8f1a-2238b79a3749 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:46.053846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:46.059272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:46.059925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:46.060303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:46.060595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:46.061321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:46.061632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:46.063295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:46.096014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 878/1727] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:46.101084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:46.115205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8497-12bd-4764-90f0-e61171447fb0 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:46.164404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:46.168621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:46.168621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:46.168621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:46.168621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:46.174088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:46.407541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 879/1728] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:46 2022] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:20:46.410491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d78175074ab4e50a175305e2ee37c6a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:46.412222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:46.417633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d78175074ab4e50a175305e2ee37c6a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:46.454058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d78175074ab4e50a175305e2ee37c6a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:46.456760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d78175074ab4e50a175305e2ee37c6a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:46.465206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:46.547413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d78175074ab4e50a175305e2ee37c6a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:46.594520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 850/1729] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:45 2022] DELETE /identity/v3/users/0d78175074ab4e50a175305e2ee37c6a => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:46.650404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6153c14-2a03-47c1-956d-b94934cbd416 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:46.723894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:46.849784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:46.851077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:46.851363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:46.851832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:46.852533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:46.861356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:47.024467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 880/1730] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:46 2022] POST /identity/v3/users => generated 302 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:47.028142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:47.029733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:47.054429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37109c-8da8-4a57-ac60-2f004156fdcd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:47.068375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:47.070202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.077450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.077450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.077450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:47.077450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:47.107895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 851/1731] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:47.112409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:47.124178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73511692-0041-4bd1-af27-3807c5ee8115 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:47.163467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:47.164621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.165721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.166483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.170759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:47.172597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd56968-b5c1-4f4a-a8aa-2f3e037990ea admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:47.235057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 881/1732] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:20:47.246722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:47.287486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650e97f-40bc-4ced-aeeb-4c76c07aa1bf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:47.318459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:47.323541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.323541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.323541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] PATH_INFO: `/v3/projects/509b2bc36ea8493ebb4077f947ad70cd/users/36a49c673cb549a59936da4ddd0672ea/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.383236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509b2bc36ea8493ebb4077f947ad70cd, user_id=36a49c673cb549a59936da4ddd0672ea, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:47.386806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c402d-defd-4c0a-93aa-1d04d7739126 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:47.486254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.486768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.487208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.528293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 852/1733] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:47 2022] PUT /identity/v3/projects/509b2bc36ea8493ebb4077f947ad70cd/users/36a49c673cb549a59936da4ddd0672ea/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:47.536286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.536961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.537433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.566850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:47.572454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:47.583635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] MFA Rules not processed for user `14c4c1027d8a42c081d69fa821216675`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:47.591207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:47.711369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 882/1734] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:47.759378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 853/1735] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:47.770295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:47.777561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:47.905695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f5cc0-6887-4b26-b10c-a2c6eaedea1f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:47.920178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:47.920929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:47.921381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:47.922280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:47.946068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:47.947689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909abda6-2467-4dbb-bcb1-4aceb97e1d94 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:47.972947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 883/1736] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:48.565610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:48.567310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:48.628881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473602-cc11-41dd-b127-40970b2e2092 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:48.648535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:48.651241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:48.653650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:48.654112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] PATH_INFO: `/v3/projects/61dda2bd091043909466e23968f58ca3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:48.659896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61dda2bd091043909466e23968f58ca3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:48.669997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:48.832517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eaab3-2ed6-4467-bef8-b184f25bf9f0 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:48.833005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eaab3-2ed6-4467-bef8-b184f25bf9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:48.833118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eaab3-2ed6-4467-bef8-b184f25bf9f0 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:48.834809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 884/1737] 10.222.0.49 () {54 vars in 912 bytes} [Mon Aug 1 14:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:20:48.841202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:48.841744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:48.842072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:48.882929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:48.883682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:48.891274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 885/1738] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:20:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:48.906452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:48.908272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:48.921562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb015ad-10e3-4066-ac54-6f68631d8f04 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:48.928969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:48.942166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:48.943046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:48.943542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:48.964250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:48.968334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefedc6a-8db4-4a39-8236-409fbe749a68 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:48.979453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61dda2bd091043909466e23968f58ca3', 'request_id': 'req-a4753e8a-ad31-40c6-9809-523d2bdafc55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:48.989545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 886/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:20:48.990557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61dda2bd091043909466e23968f58ca3', 'request_id': 'req-a4753e8a-ad31-40c6-9809-523d2bdafc55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:49.012295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61dda2bd091043909466e23968f58ca3', 'request_id': 'req-a4753e8a-ad31-40c6-9809-523d2bdafc55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:49.123513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] The token cache is being invalidate because project 61dda2bd091043909466e23968f58ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:49.123820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:49.125195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4753e8a-ad31-40c6-9809-523d2bdafc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:49.128994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 854/1740] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:48 2022] DELETE /identity/v3/projects/61dda2bd091043909466e23968f58ca3 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:49.133595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173c0-9fd4-4f84-89b2-dfe5d8510f1b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.134214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173c0-9fd4-4f84-89b2-dfe5d8510f1b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.134600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173c0-9fd4-4f84-89b2-dfe5d8510f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.175294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4ac173c0-9fd4-4f84-89b2-dfe5d8510f1b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:49.181202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ac173c0-9fd4-4f84-89b2-dfe5d8510f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:49.331106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 887/1741] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:49.332866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.333163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.338360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.364134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:49.367212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:49.384403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621441-0467-433d-9d52-6511660525f2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.384902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621441-0467-433d-9d52-6511660525f2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.385208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621441-0467-433d-9d52-6511660525f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.401357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 855/1742] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:49.411465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:49.423002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013a931-4f4d-45ef-973b-eeab6a4456d3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:49.425095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2d621441-0467-433d-9d52-6511660525f2 None None] MFA Rules not processed for user `47da4644803547869a303a039ee7a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:49.426129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2d621441-0467-433d-9d52-6511660525f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:49.430143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:49.431529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.431889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.432243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.433139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:20:49.434412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:49.436776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:49.457195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 856/1743] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:49.458364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:49.472772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa74eb-5b41-4e60-99a2-56e2fc49c93c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:49.480494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:49.480778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.481150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.481441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.482284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:49.484896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:49.572516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 888/1744] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:49.612085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 857/1745] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:49 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:49.613978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d621441-0467-433d-9d52-6511660525f2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:49.634336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d621441-0467-433d-9d52-6511660525f2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:49.659416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:49.800937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:49.822735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:49.823149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:49.823348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:49.832208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:49.839194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:50.012157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 889/1746] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:49 2022] POST /identity/v3/users => generated 283 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:50.016269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:50.039092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51124dc-d1b2-4819-a305-45d7e7e8c54d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:50.058462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:50.060557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:50.060853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:50.061135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:50.061892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:50.068052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075dd2-8b1b-4200-9606-66fbb3fb92ae admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:50.099556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:50.103053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:50.103211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 858/1747] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:20:50.149531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26776c39-9fcd-4166-8467-62d1742673ca admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:50.171733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:50.174744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:50.175081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:50.175370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:50.181155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:50.185532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:50.186522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:50.189072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:50.189393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:50.208514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 890/1748] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:50.211952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:50.236498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0bba9-8ac4-4de3-91ec-b432c883e167 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:50.250931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:50.255263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:50.255263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:50.255263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] PATH_INFO: `/v3/projects/efe71a942ea8478f9891c54a086976c8/users/32a2707f1fcd4de9b6ff7ac24b7ff407/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:50.306024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe71a942ea8478f9891c54a086976c8, user_id=32a2707f1fcd4de9b6ff7ac24b7ff407, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:50.327606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c540-6377-40ce-b720-e592d2909d0a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:50.366414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:50.367992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:50.444042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 891/1749] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:50 2022] PUT /identity/v3/projects/efe71a942ea8478f9891c54a086976c8/users/32a2707f1fcd4de9b6ff7ac24b7ff407/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:50.462774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:50.463076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:50.463353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:50.575579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] MFA Rules not processed for user `32a2707f1fcd4de9b6ff7ac24b7ff407`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:50.576814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:50.582389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 859/1750] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:50.816582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 892/1751] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:50.822419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:50.837095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b05d8f-793f-47a2-af20-87677750d74c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:51.064938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:51.065787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:51.066214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:51.066633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:51.067447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:51.069958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:51.278857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:51.282533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:51.311936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 860/1752] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:50 2022] POST /identity/v3/projects => generated 361 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:51.315339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:51.455534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974060b-8a58-4f96-ba1d-ad57e6aab4ba admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:51.458152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:51.458947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:51.460683 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:51.461055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:51.461875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:51.466070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:51.520530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74edbc-e17d-475e-b779-fc56d27d1e03 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:51.569415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:51.627566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:51.628236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:51.628527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:51.628808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:51.641803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 861/1753] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:51 2022] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:20:51.645899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:51.665118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb207-3136-4b24-b6fc-55cde13e1ba6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:51.679262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:51.679907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:51.680198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:51.680481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:51.681196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:51.682870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:51.722988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 862/1754] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:51.727178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:51.747770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222928-17c8-4c53-ae35-993a1123704e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:51.766704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:51.767589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:51.768032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:51.768464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] PATH_INFO: `/v3/projects/b2fdb3109d534a7c92f887665da3f11f/users/fd146bae44b94cf590db09b525cf4c33/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:51.813554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fdb3109d534a7c92f887665da3f11f, user_id=fd146bae44b94cf590db09b525cf4c33, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:51.816732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:51.857208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:51.863480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:51.917215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 893/1755] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:20:51.996882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 863/1756] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:51 2022] PUT /identity/v3/projects/b2fdb3109d534a7c92f887665da3f11f/users/fd146bae44b94cf590db09b525cf4c33/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:52.001690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:52.026556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5653a-c6d9-4601-b574-f425b8e39e21 service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:52.171179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:52.173528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.174237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:52.176419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.176419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.176419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.176419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:52.177716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:52.208087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 894/1757] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:52.208820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:52.221402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb04b4-7e60-4e7a-89fa-54b2abf9cd5f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:52.250579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:52.251344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.251533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.255604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] PATH_INFO: `/v3/users/eb0629ab5acd41dbbe054ef8b0be007a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.265047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b25d5-5400-4c26-a9cf-9fc085abc3ae admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:52.276084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:52.276961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.277079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0629ab5acd41dbbe054ef8b0be007a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:52.278316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.279325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] PATH_INFO: `/v3/projects/b2fdb3109d534a7c92f887665da3f11f/users/fd146bae44b94cf590db09b525cf4c33/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.279818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:52.295999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fdb3109d534a7c92f887665da3f11f, user_id=fd146bae44b94cf590db09b525cf4c33, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:52.299088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96f4b-fa26-4bce-b0ec-82d6c7ae965b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:52.319412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 895/1758] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:52 2022] PUT /identity/v3/projects/b2fdb3109d534a7c92f887665da3f11f/users/fd146bae44b94cf590db09b525cf4c33/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:52.332042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70cca-7ae7-4009-bb8c-11c17ed5ce9c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.332672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70cca-7ae7-4009-bb8c-11c17ed5ce9c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.333313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70cca-7ae7-4009-bb8c-11c17ed5ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.429226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-55e70cca-7ae7-4009-bb8c-11c17ed5ce9c None None] MFA Rules not processed for user `fd146bae44b94cf590db09b525cf4c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:52.432294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-55e70cca-7ae7-4009-bb8c-11c17ed5ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.476238 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:52.591908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0629ab5acd41dbbe054ef8b0be007a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:52.592679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0629ab5acd41dbbe054ef8b0be007a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:52.607244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0629ab5acd41dbbe054ef8b0be007a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:52.608360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0629ab5acd41dbbe054ef8b0be007a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:52.694845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bec1ff19-7332-4226-a4c7-2e2bb12f37b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0629ab5acd41dbbe054ef8b0be007a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:52.731103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 864/1759] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:52 2022] DELETE /identity/v3/users/eb0629ab5acd41dbbe054ef8b0be007a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:52.733738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249118ce-eac0-4efb-806d-55b41751569b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.733738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249118ce-eac0-4efb-806d-55b41751569b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.733738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249118ce-eac0-4efb-806d-55b41751569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.737102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 896/1760] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:52.743597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.749641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.750422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.792653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-249118ce-eac0-4efb-806d-55b41751569b None None] MFA Rules not processed for user `36a49c673cb549a59936da4ddd0672ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:52.793963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-249118ce-eac0-4efb-806d-55b41751569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.807689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:52.811369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.913291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 865/1761] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:52.914690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249118ce-eac0-4efb-806d-55b41751569b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:52.916449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-249118ce-eac0-4efb-806d-55b41751569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.918236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 897/1762] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:52.923213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:52.923213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:52.945521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d176ef-9e87-49f7-9726-dd57ee6bb11e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:52.957240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:52.958300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:52.959006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:52.959402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:52.960885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:52.970088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.039798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249118ce-eac0-4efb-806d-55b41751569b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:53.045902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:53.046818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:53.047256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:53.047697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:53.115468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 898/1763] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:20:52 2022] POST /identity/v3/projects => generated 403 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:53.119239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:53.130318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:53.175334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:53.179882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.205071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 866/1764] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:52 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:53.205805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:53.232049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604d78-0ec0-4ec0-906d-86839018a4f9 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:53.291209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630275-0b6b-4865-aa27-a542018cb33f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:53.301898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:53.304122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:53.304503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:53.304792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:53.439148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:53.440215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:53.441418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:53.441418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:53.445217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:53.453169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.486770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:53.491825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.534219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 899/1765] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:53.617070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:53.738831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 867/1766] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:20:53 2022] POST /identity/v3/users => generated 308 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:20:53.743594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:53.761636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4eff2-42c0-4b0c-9e9e-830a995134d0 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:53.795348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:53.797948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:53.798243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:53.800294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:53.806037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:53.811813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.867881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:53.868737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 900/1767] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:53.888283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca89ba-2566-4069-9bb7-c95c55a57184 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:53.902324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:53.902492 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:53.902773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:53.903282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] PATH_INFO: `/v3/projects/29ca16e926624c9e900a73664f042c90/users/0515773d3a684999831f0b2c3872e3e0/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:53.937073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ca16e926624c9e900a73664f042c90, user_id=0515773d3a684999831f0b2c3872e3e0, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:53.944527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:53.978295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:54.089827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4765-c14d-4e4b-8305-84d569ede461 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:54.098691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 868/1768] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:53 2022] PUT /identity/v3/projects/29ca16e926624c9e900a73664f042c90/users/0515773d3a684999831f0b2c3872e3e0/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:20:54.103829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:54.207461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:54.208515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:54.209017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:54.209464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:54.218299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:54.394549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0b033-05b7-4580-ba9a-e1bd4fe41575 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:54.408998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:54.411339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b207d-baff-42c9-8b86-86ec058737bc service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:54.418532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:54.419926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:54.420466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:54.420948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:54.426312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:54.429804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:54.431104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 901/1769] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:20:54.448068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:54.449517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:54.449680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 869/1770] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:20:54.450117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:54.457560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:54.472368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119f46-6a0c-4960-a2f2-47e3f7702c32 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:54.501564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:54.510158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:54.525128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:54.530406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:54.530695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:54.532671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] PATH_INFO: `/v3/projects/29ca16e926624c9e900a73664f042c90/users/0515773d3a684999831f0b2c3872e3e0/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:54.543535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ca16e926624c9e900a73664f042c90, user_id=0515773d3a684999831f0b2c3872e3e0, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:54.546526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:54.569601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 870/1771] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:20:54 2022] PUT /identity/v3/projects/29ca16e926624c9e900a73664f042c90/users/0515773d3a684999831f0b2c3872e3e0/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:54.645501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 902/1772] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 1 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:54.738414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:54.742736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:54.747383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:54.749150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:54.801679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14498969-ac53-4a0a-a20f-ca3e7e991e5b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:54.976108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ad48c-375f-4527-aea3-07fda7d67410 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:54.988452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:54.989118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:54.989398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:54.990091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:55.002781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:55.005819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:55.034638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 871/1773] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:55.065541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:55.066421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:55.069718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:55.073022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:55.092908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:55.097134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:55.108670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:55.127934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a8ca-45b8-4b97-87f1-4584a879e9f8 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:55.130325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 903/1774] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:55.147651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:55.148831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:55.149620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:55.150183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:55.181774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:55.183299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:55.197333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 872/1775] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:55.594989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:55.597034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:55.667946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:55.729174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:55.738185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eb495-f614-40e6-9390-82718859c796 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:55.769777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:55.770808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:55.771276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:55.774002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] PATH_INFO: `/v3/projects/b8127b6913b1470093db2173dd2dd5b9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:55.777779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8127b6913b1470093db2173dd2dd5b9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:55.780450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:56.009808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8127b6913b1470093db2173dd2dd5b9', 'request_id': 'req-c987ccde-6d07-420c-82ab-3bb07a0fa61f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.023100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8127b6913b1470093db2173dd2dd5b9', 'request_id': 'req-c987ccde-6d07-420c-82ab-3bb07a0fa61f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.030149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8127b6913b1470093db2173dd2dd5b9', 'request_id': 'req-c987ccde-6d07-420c-82ab-3bb07a0fa61f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.140430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] The token cache is being invalidate because project b8127b6913b1470093db2173dd2dd5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:56.140913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.141885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c987ccde-6d07-420c-82ab-3bb07a0fa61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.150865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:56.152230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 904/1776] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:55 2022] DELETE /identity/v3/projects/b8127b6913b1470093db2173dd2dd5b9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:56.171923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0076-11bd-4e0a-8c83-6edaa774c0b9 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:56.290630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:56.291659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:56.292159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:56.292662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] PATH_INFO: `/v3/users/f64d4176070a4cea9ecee76eb4d2d076` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:56.294791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64d4176070a4cea9ecee76eb4d2d076)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:56.297134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:56.583258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64d4176070a4cea9ecee76eb4d2d076'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.589293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64d4176070a4cea9ecee76eb4d2d076'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.606261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64d4176070a4cea9ecee76eb4d2d076'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.607229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64d4176070a4cea9ecee76eb4d2d076'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.708487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2fa45cb3-12ae-47c3-9bd7-a3410ebd03eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64d4176070a4cea9ecee76eb4d2d076'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:56.750142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 873/1777] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:20:56 2022] DELETE /identity/v3/users/f64d4176070a4cea9ecee76eb4d2d076 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:57.057099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:57.972493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:58.071761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:58.415247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:58.583099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:58.585255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:58.585571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:58.587402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 905/1778] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:20:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:58.619083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:58.619083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:58.619465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:58.663507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:58.667921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:58.960144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 874/1779] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:59.001271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:59.003160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:59.024860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:59.026882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:59.055332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55f7f-3265-45f6-881b-0d5f2991fee9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:59.076643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:59.077948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:59.078590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:59.079087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:59.104336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:59.106209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c8172-5cec-423e-9fe5-f142e3758653 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:59.128975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 875/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:59.204914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7835d-5a1c-4c7d-80d6-932a5391d183 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:59.238698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:59.239889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:59.240602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:59.242901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] PATH_INFO: `/v3/projects/1ead1ce4dfbc41848b370248959a5fcf` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:59.247575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ead1ce4dfbc41848b370248959a5fcf)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:59.254757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:59.286476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:59.492122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ead1ce4dfbc41848b370248959a5fcf', 'request_id': 'req-aa34041e-161f-4e9b-af12-9e21a6401ce6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:59.504386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ead1ce4dfbc41848b370248959a5fcf', 'request_id': 'req-aa34041e-161f-4e9b-af12-9e21a6401ce6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:59.527078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ead1ce4dfbc41848b370248959a5fcf', 'request_id': 'req-aa34041e-161f-4e9b-af12-9e21a6401ce6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:59.634824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] The token cache is being invalidate because project 1ead1ce4dfbc41848b370248959a5fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:20:59.635693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:59.644062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aa34041e-161f-4e9b-af12-9e21a6401ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:20:59.650166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 906/1781] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:20:59 2022] DELETE /identity/v3/projects/1ead1ce4dfbc41848b370248959a5fcf => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:20:59.661541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:59.661541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:59.661541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:59.701839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:59.714963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:59.732404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:59.831034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 876/1782] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:59.844477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:59.844990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:59.845378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:59.873005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:59.874952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:59.902645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 907/1783] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:59.907964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:59.950578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7b973-c55e-4bd0-9ec0-9b2559270b2b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.013930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.014597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.014887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.015171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.015890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:00.016207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.027763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:00.062792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 877/1784] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:00.065603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:00.088233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540030-bc88-41d9-a2c2-92e7d0a155a4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.099451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.101595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.112277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.112277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.112277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.112277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:00.278753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:00.292313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 908/1785] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:00 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:00.300088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c543cb-77e1-4749-b566-c14b96d23e04 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.430015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.430771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.431064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.431426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.432188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.434655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:00.562254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 878/1786] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:00 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:00.567583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:00.583199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f18b1-d8b3-493f-9b13-0b53285e5f5d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.602937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.606420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.606826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.608425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.614452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.621028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:00.672333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 909/1787] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:00.677076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:00.699187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a70c7-2e55-4510-9d57-8be07a9aa8db admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.714605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.715303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.715626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.716235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.716964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.722997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700cb9c-e28f-4333-b412-48d3c9026953 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:00.751950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 879/1788] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:00.760213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:00.811198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187d368-153b-4256-a445-32b57003ed8f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:00.845247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:00.846350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:00.849333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:00.851809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] PATH_INFO: `/v3/projects/a883e288fdf645e887f6ffac0f756ed7/users/fb79c82ee3a847d18958ea096ab49df2/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:00.916604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a883e288fdf645e887f6ffac0f756ed7, user_id=fb79c82ee3a847d18958ea096ab49df2, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:00.919859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad04ba-5b62-4c38-bca7-1e0059ba7cb1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:01.036872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 910/1789] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:00 2022] PUT /identity/v3/projects/a883e288fdf645e887f6ffac0f756ed7/users/fb79c82ee3a847d18958ea096ab49df2/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:01.052652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.052652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.054833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.095897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] MFA Rules not processed for user `fb79c82ee3a847d18958ea096ab49df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:01.097189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:01.145876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.146640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.147097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.201253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] MFA Rules not processed for user `0515773d3a684999831f0b2c3872e3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:01.202706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:01.222257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 880/1790] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:01.223324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:01.248077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:01.371844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 911/1791] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:01.385487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517402e-a256-4b49-9ffd-b49431c7f379 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:01.390540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:01.391362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.391811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.392304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.393125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:01.396335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:01.545090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 881/1792] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:01 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:01.550488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:01.566457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd21f-d7ce-4393-a520-9bfe18a39c0e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:01.601703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:01.652037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:01.652794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.653140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.653570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.654363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:01.656312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:01.774341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 912/1793] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:01 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:01.778085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:01.806318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4df36-bcc1-475f-a23f-e9c4f18b5b8f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:01.830202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:01.830202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.830202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.830202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.830811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:01.830811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:01.843412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 882/1794] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:01.845032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:01.867820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec9f8-826e-41aa-ae59-4d545121fda4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:01.875757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:01.876561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:01.876907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:01.877400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] PATH_INFO: `/v3/projects/fa4bd75af04e46e1af1b13f150a16f77/users/f7953fda59d348c988ce1d4350ed9e12/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:01.909221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4bd75af04e46e1af1b13f150a16f77, user_id=f7953fda59d348c988ce1d4350ed9e12, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:01.913291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:02.021176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 913/1795] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:01 2022] PUT /identity/v3/projects/fa4bd75af04e46e1af1b13f150a16f77/users/f7953fda59d348c988ce1d4350ed9e12/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:02.026662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:02.037946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b2d-b252-401e-8ca9-defd6e357bc0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:02.099045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:02.099680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.100670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.101065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.101963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:02.103633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce58bc-6ead-4ff8-9347-aaa0a848f850 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:02.116108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 883/1796] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:02.124123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:02.135699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554831b-6092-453d-8dc9-47c54b3a68b5 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:02.140368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:02.143889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.143889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.143889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] PATH_INFO: `/v3/projects/fa4bd75af04e46e1af1b13f150a16f77/users/f7953fda59d348c988ce1d4350ed9e12/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.143889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4bd75af04e46e1af1b13f150a16f77, user_id=f7953fda59d348c988ce1d4350ed9e12, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:02.146444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90976-398d-4158-84ae-f868ee6d45cf admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:02.157835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 914/1797] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:02 2022] PUT /identity/v3/projects/fa4bd75af04e46e1af1b13f150a16f77/users/f7953fda59d348c988ce1d4350ed9e12/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:02.169365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.169679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.169986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.201216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] MFA Rules not processed for user `f7953fda59d348c988ce1d4350ed9e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:02.202500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:02.277018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 884/1798] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:02.290732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:02.292224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:02.299441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f50d-1cf5-45e1-835f-edeb448b0b86 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.301916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f50d-1cf5-45e1-835f-edeb448b0b86 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.302043 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:02.302228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301f50d-1cf5-45e1-835f-edeb448b0b86 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.305880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 915/1799] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:21:02 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:21:02.317584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.317947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.318275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.346411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:02.347643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:02.353941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8457632-1cb8-4443-b3f6-a05ba7681cd0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:02.357838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:02.358473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.358760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.359039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.371604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:02.375191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:02.388907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 885/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:21:02.441516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 916/1801] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:02.451834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:02.453336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:02.482974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334228-2bbd-402d-a265-905ec689c115 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:02.490025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf166-4869-4215-9543-16531718427d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:02.500985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf166-4869-4215-9543-16531718427d service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:02.500985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf166-4869-4215-9543-16531718427d service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:02.500985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf166-4869-4215-9543-16531718427d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:02.522784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaf166-4869-4215-9543-16531718427d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:02.524337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaf166-4869-4215-9543-16531718427d service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:02.535463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 886/1802] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:03.345128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:03.345128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:03.481235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ffc2f-3e0c-41ae-853a-d6b7f0ed661c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:03.487196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:03.487895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:03.488286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:03.488572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] PATH_INFO: `/v3/users/36a49c673cb549a59936da4ddd0672ea` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:03.498833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a49c673cb549a59936da4ddd0672ea)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:03.502203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:03.511770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf166-4869-4215-9543-16531718427d service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:03.526754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf166-4869-4215-9543-16531718427d service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:03.533647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7953fda59d348c988ce1d4350ed9e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa4bd75af04e46e1af1b13f150a16f77', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:03.534743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:03.535214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:03.535853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:03.536781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:03.537358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:03.540175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:03.557811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 887/1803] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:21:03.567171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:03.586988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:03.596105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14e5c-3278-40a4-a5fb-2640087d1b4f tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:03.596105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7953fda59d348c988ce1d4350ed9e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa4bd75af04e46e1af1b13f150a16f77', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:03.596410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:03.596706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:03.597173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:03.598707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:03.602347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:03.763114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 888/1804] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:03 2022] POST /identity/v3/projects => generated 355 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:03.767663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:03.807834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a49c673cb549a59936da4ddd0672ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:03.808560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a49c673cb549a59936da4ddd0672ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:03.847892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a49c673cb549a59936da4ddd0672ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:03.874867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a49c673cb549a59936da4ddd0672ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:03.898635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887ad6-d43f-445f-8861-ab7bc694690e tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:03.904739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7953fda59d348c988ce1d4350ed9e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa4bd75af04e46e1af1b13f150a16f77', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:03.905560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:03.905903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:03.906312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:03.907046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:03.907434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:03.909586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:03.925828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 889/1805] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:03.969134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a49c673cb549a59936da4ddd0672ea'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:03.978315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 917/1806] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:03 2022] DELETE /identity/v3/users/36a49c673cb549a59936da4ddd0672ea => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:03.992768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:03.992768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:04.004291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e44ff-a5f0-4727-a0e0-a9b48e6d54f4 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:04.146457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:04.168320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7953fda59d348c988ce1d4350ed9e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa4bd75af04e46e1af1b13f150a16f77', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:04.168995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:04.169433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:04.169662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] PATH_INFO: `/v3/projects/1af87875aead4cc195b97e884dcd073a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:04.173910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1af87875aead4cc195b97e884dcd073a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:04.175865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:04.387576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:04.390433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:04.406320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af87875aead4cc195b97e884dcd073a', 'request_id': 'req-8d627a45-fea0-4b21-a30f-656b73860922'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.416362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af87875aead4cc195b97e884dcd073a', 'request_id': 'req-8d627a45-fea0-4b21-a30f-656b73860922'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.432567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af87875aead4cc195b97e884dcd073a', 'request_id': 'req-8d627a45-fea0-4b21-a30f-656b73860922'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.547821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] The token cache is being invalidate because project 1af87875aead4cc195b97e884dcd073a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:04.548524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.549648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.556810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 890/1807] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:03 2022] DELETE /identity/v3/projects/1af87875aead4cc195b97e884dcd073a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:04.580439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d244-1d21-4a08-b0c8-ecb343f570b3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:04.699603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:04.700547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:04.700902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:04.701375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] PATH_INFO: `/v3/projects/509b2bc36ea8493ebb4077f947ad70cd` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:04.703099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509b2bc36ea8493ebb4077f947ad70cd)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:04.706055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:04.863121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509b2bc36ea8493ebb4077f947ad70cd', 'request_id': 'req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.874783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509b2bc36ea8493ebb4077f947ad70cd', 'request_id': 'req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.886182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509b2bc36ea8493ebb4077f947ad70cd', 'request_id': 'req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.975110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] The token cache is being invalidate because project 509b2bc36ea8493ebb4077f947ad70cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:04.975884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.977065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:04.982215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 918/1808] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:04 2022] DELETE /identity/v3/projects/509b2bc36ea8493ebb4077f947ad70cd => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:04.983360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:04.985209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:05.018599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d627a45-fea0-4b21-a30f-656b73860922 tempest-VolumeQuotaClassesTest-52424133 tempest-VolumeQuotaClassesTest-52424133-project-admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:05.110427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:05.111308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:05.113970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:05.114547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] PATH_INFO: `/v3/users/0515773d3a684999831f0b2c3872e3e0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:05.116958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0515773d3a684999831f0b2c3872e3e0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:05.120085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:05.124301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:05.297488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:05.299149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:05.313288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1cfd1-77b7-4a5a-bcf2-8bd0c3824d44 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:05.319611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:05.320174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:05.320403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:05.320928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] PATH_INFO: `/v3/users/fb79c82ee3a847d18958ea096ab49df2` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:05.323176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb79c82ee3a847d18958ea096ab49df2)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:05.324479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:05.354957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0515773d3a684999831f0b2c3872e3e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.355646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0515773d3a684999831f0b2c3872e3e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.391698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0515773d3a684999831f0b2c3872e3e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.397219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0515773d3a684999831f0b2c3872e3e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.547861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-406326f1-b15d-4275-945e-9e55f8de63bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0515773d3a684999831f0b2c3872e3e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.569967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 891/1809] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:04 2022] DELETE /identity/v3/users/0515773d3a684999831f0b2c3872e3e0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:05.660319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb79c82ee3a847d18958ea096ab49df2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.662796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb79c82ee3a847d18958ea096ab49df2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.686164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb79c82ee3a847d18958ea096ab49df2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.700717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb79c82ee3a847d18958ea096ab49df2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.773203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb79c82ee3a847d18958ea096ab49df2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:05.783682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 919/1810] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:05 2022] DELETE /identity/v3/users/fb79c82ee3a847d18958ea096ab49df2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:05.786082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:05.786835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:05.787386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:05.797374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:05.809460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:05.810895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:05.889597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:05.891469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:05.924408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 892/1811] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:05.946357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:05.949061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:05.989563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5abe-4c2a-4b68-a21d-0817c37b926f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:05.995522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:05.996173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:05.996461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:05.996747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] PATH_INFO: `/v3/projects/29ca16e926624c9e900a73664f042c90` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:05.998144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ca16e926624c9e900a73664f042c90)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.000184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:06.028215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14870d-659d-40f3-bd72-ccb838132098 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:06.030590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:06.031244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.031528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.031807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.043577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.045575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ab065-30d4-4ced-a1cb-20f7de13513b service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:06.057491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 893/1812] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:06.333108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ca16e926624c9e900a73664f042c90', 'request_id': 'req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:06.339418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ca16e926624c9e900a73664f042c90', 'request_id': 'req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:06.344897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ca16e926624c9e900a73664f042c90', 'request_id': 'req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:06.449968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] The token cache is being invalidate because project 29ca16e926624c9e900a73664f042c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:06.450262 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:06.454629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e421cd55-cb25-4e58-b9ea-ae7b3c04e569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:06.456599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 920/1813] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:05 2022] DELETE /identity/v3/projects/29ca16e926624c9e900a73664f042c90 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:06.461915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.462817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.463239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.487079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:06.488200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:06.563189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 894/1814] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:06.571534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.572622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.572622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.592130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:06.595624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:06.601650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 921/1815] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:06.605778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:06.616296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801de3-cafb-4f7c-9e91-04748015e337 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:06.621358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:06.622027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.622310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.622585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.623288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:06.623595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.625199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:06.640966 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 895/1816] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:06.642129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:06.652485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f03f2d-c726-411d-9296-5113e73d6fcd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:06.657191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:06.657851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.658141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.658420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.664526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.664526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:06.776874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:06.784865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:06.786006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 922/1817] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:06 2022] POST /identity/v3/projects => generated 355 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:06.790201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:06.801366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a2ae-f606-4f5f-b215-9a2ee46e5318 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:06.872547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f775d7-89b6-4e84-8571-84af9817e879 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:06.877357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:06.878033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.878316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.878445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:06.878647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.879106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:06.879304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.879414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:06.879814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] PATH_INFO: `/v3/projects/a883e288fdf645e887f6ffac0f756ed7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:06.881564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a883e288fdf645e887f6ffac0f756ed7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:06.882029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:06.884034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.009980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 923/1818] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:06 2022] POST /identity/v3/users => generated 278 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:07.013960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.025315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de665-4a39-41f1-97fc-5c786337b3cf admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.030062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.030895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.031196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.031419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.032124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.033736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.045064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 924/1819] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:07.050021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.052700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a883e288fdf645e887f6ffac0f756ed7', 'request_id': 'req-8a348074-cc71-415b-9abd-6b98c6e4615f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.059938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a883e288fdf645e887f6ffac0f756ed7', 'request_id': 'req-8a348074-cc71-415b-9abd-6b98c6e4615f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.060954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c761-4676-4b09-9689-3dc8d664995f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.066964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a883e288fdf645e887f6ffac0f756ed7', 'request_id': 'req-8a348074-cc71-415b-9abd-6b98c6e4615f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.128415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.129092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.129374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.129647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.130376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.132358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.142632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 925/1820] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:07.149531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.157446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6e5d-f6b7-43da-822e-2961e1bde208 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.162738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.163426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.163735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.164011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] PATH_INFO: `/v3/projects/7074ac354cbe4cbe9c27d5e1dd52c3c9/users/2b3b8b7652fb4799ad92039f24f84648/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.180619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7074ac354cbe4cbe9c27d5e1dd52c3c9, user_id=2b3b8b7652fb4799ad92039f24f84648, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.183450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5d07d-1247-4fb4-a950-64fcd4fb73fc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.206520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] The token cache is being invalidate because project a883e288fdf645e887f6ffac0f756ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:07.206813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.207654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.210005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 896/1821] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:06 2022] DELETE /identity/v3/projects/a883e288fdf645e887f6ffac0f756ed7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:07.214187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.215565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:07.229390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a348074-cc71-415b-9abd-6b98c6e4615f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.234399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.235075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.235404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.235690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] PATH_INFO: `/v3/users/f7953fda59d348c988ce1d4350ed9e12` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.236912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7953fda59d348c988ce1d4350ed9e12)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.238879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.288707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 926/1822] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:07 2022] PUT /identity/v3/projects/7074ac354cbe4cbe9c27d5e1dd52c3c9/users/2b3b8b7652fb4799ad92039f24f84648/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:07.303621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.304176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.304530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.336545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] MFA Rules not processed for user `2b3b8b7652fb4799ad92039f24f84648`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:07.337974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:07.416572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 927/1823] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:07.421041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.422467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:07.461384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7953fda59d348c988ce1d4350ed9e12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.462179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7953fda59d348c988ce1d4350ed9e12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.478514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7953fda59d348c988ce1d4350ed9e12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.482269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7953fda59d348c988ce1d4350ed9e12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.493316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd15157-5239-4495-840f-9e39e48c59a5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.499490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.500352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.500495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.500833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.501618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.504048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.561873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7953fda59d348c988ce1d4350ed9e12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:07.587310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 897/1824] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:07 2022] DELETE /identity/v3/users/f7953fda59d348c988ce1d4350ed9e12 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:07.654666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:07.661799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 928/1825] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:07 2022] POST /identity/v3/projects => generated 357 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:07.667260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.668987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:07.749828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73a4d-ba29-4661-a71d-efa3d05a37dc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.834697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.835345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.835636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.835958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.836636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.838588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:07.960870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 898/1826] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:07 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:07.967736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:07.982511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bebab-65a5-4b7c-af50-94d091630e5c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:07.988403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:07.989181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:07.989540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:07.989996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:07.990917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:07.993894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.013407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 929/1827] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:08.014407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.026807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99cbdc-cc3a-499f-ac07-7c5f0bd1c309 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.032405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.033041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.033365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.033605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] PATH_INFO: `/v3/projects/b087b0c4be52444da88bd7fd658d2572/users/6f23f1b82d3848aeb66aa0d7d6251c04/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.054726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087b0c4be52444da88bd7fd658d2572, user_id=6f23f1b82d3848aeb66aa0d7d6251c04, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.058490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.129370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:08.168269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 899/1828] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:08 2022] PUT /identity/v3/projects/b087b0c4be52444da88bd7fd658d2572/users/6f23f1b82d3848aeb66aa0d7d6251c04/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:08.172610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.183091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c08e4f-68ec-450f-b6f2-f8e89e76666c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.241848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.242475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.242827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.243207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.244055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.246040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc7fbd-8ed3-49cd-b5df-e5762e2761e5 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.258633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 930/1829] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:08.263269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.275820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b9cc-d3b0-4afb-b572-83382635cfbc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.285521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.285521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.285521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.285521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] PATH_INFO: `/v3/projects/b087b0c4be52444da88bd7fd658d2572/users/6f23f1b82d3848aeb66aa0d7d6251c04/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.286343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087b0c4be52444da88bd7fd658d2572, user_id=6f23f1b82d3848aeb66aa0d7d6251c04, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.290933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.317567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 900/1830] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:08 2022] PUT /identity/v3/projects/b087b0c4be52444da88bd7fd658d2572/users/6f23f1b82d3848aeb66aa0d7d6251c04/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:08.320172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.320464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.320744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.353668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] MFA Rules not processed for user `6f23f1b82d3848aeb66aa0d7d6251c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:08.355260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:08.430770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:08.466062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 931/1831] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:08.483501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.487601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:08.606934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd01b8-6118-4e88-bb1d-b9879a096e76 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.611835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.612561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.612907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.613677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.624231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.625679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.637084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 901/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:08.682383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.684159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:08.802362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b303-3ced-42b2-a8c8-79b7ae186b2b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.807777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.812210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.812210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.812210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] PATH_INFO: `/v3/projects/fa4bd75af04e46e1af1b13f150a16f77` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.812210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4bd75af04e46e1af1b13f150a16f77)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.812914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.882431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:08.890672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033a2f-b2c6-4f8b-a893-72bd064be617 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:08.894365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:08.894976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:08.895253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:08.895527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:08.898103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:08.934172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4bd75af04e46e1af1b13f150a16f77', 'request_id': 'req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:08.962728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4bd75af04e46e1af1b13f150a16f77', 'request_id': 'req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:08.966524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:08.966668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:08.968030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbcaa6-39f8-4c6a-9dba-ba108c297428 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:08.975622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4bd75af04e46e1af1b13f150a16f77', 'request_id': 'req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:08.978984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 902/1833] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:09.040362 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627744c6-002f-4666-a1eb-4462eb766b8f None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.040714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627744c6-002f-4666-a1eb-4462eb766b8f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.041205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627744c6-002f-4666-a1eb-4462eb766b8f None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.043669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 903/1834] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:21:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:21:09.054514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.055121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.055414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.077733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:09.089697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] The token cache is being invalidate because project fa4bd75af04e46e1af1b13f150a16f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:09.089697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:09.090009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:09.090123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c7bf3ebc-9eb4-4a7e-a478-fe48da18abb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:09.090123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 932/1835] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:08 2022] DELETE /identity/v3/projects/fa4bd75af04e46e1af1b13f150a16f77 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:09.090123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c7a4-4c41-4518-9648-9064f6a91a14 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.090123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c7a4-4c41-4518-9648-9064f6a91a14 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.090123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0c7a4-4c41-4518-9648-9064f6a91a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.111777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-eea0c7a4-4c41-4518-9648-9064f6a91a14 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:09.113100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-eea0c7a4-4c41-4518-9648-9064f6a91a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:09.163130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 904/1836] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:09.175422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.176825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:09.191600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ea7a-15bd-45be-a8cf-5ecc03401637 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.196215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 933/1837] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:09.200875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.201824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.204102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.204102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.206008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.206301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.206576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.214997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.216643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.228170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 905/1838] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:09.228341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:09.229591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:09.238227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 934/1839] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:09.243340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.258314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260b3d-3159-4782-9683-5b56f346b89d service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.262992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.263617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.263907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.264274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.265006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:09.265346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.267085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.281798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 906/1840] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:09.285025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.298593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13cde1-a9bf-4b72-ba04-c7b03b4d9d6d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.307164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.307990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.308442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.309173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.310099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.312120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.424339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 935/1841] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:09.430201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.440642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479554-15c9-4847-9451-6a47141ea8a5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.543337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.545804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.545804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.545804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.545804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.548286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.626214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:09.632754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 907/1842] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:09.638285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.649670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06877-2667-45d8-b8e2-9cd88f9c0dc9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.654440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.655062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.655348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.655625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.656322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.658055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.669665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 936/1843] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:09.673887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.684419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712e760-57dc-4f62-b06c-d50b33961752 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.689478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.690135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.690424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.690702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.691399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.693013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec35414-3319-47af-a4f5-04bc85fcfdeb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.704447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 908/1844] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:09.715769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:09.727360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8713e-eca1-4273-a32f-44e81a5a609d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:09.732199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:09.735635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.735998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.736234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] PATH_INFO: `/v3/projects/1bfa68843a0a420c9a7aca3c453b4ee2/users/7794dc091acb41c99022aef243adce65/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.753834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfa68843a0a420c9a7aca3c453b4ee2, user_id=7794dc091acb41c99022aef243adce65, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:09.756833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:09.843180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 937/1845] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:09 2022] PUT /identity/v3/projects/1bfa68843a0a420c9a7aca3c453b4ee2/users/7794dc091acb41c99022aef243adce65/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:09.854787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:09.855327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:09.855609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:09.885221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] MFA Rules not processed for user `7794dc091acb41c99022aef243adce65`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:09.886585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:09.955563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 909/1846] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:09.960843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.024920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800665eb-21de-4cea-98e5-1bb254009825 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.029647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.030303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.031199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.031495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.032174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.034189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.123829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 938/1847] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:09 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:10.127988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.139172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4e39-8a73-4671-abc4-b810c6dff899 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.144334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:10.196254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.196886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.197176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.197455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.198170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.200147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.283703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 910/1848] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:10 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:10.288230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.298887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1294-6f87-41ad-9547-a8694ed79ae8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.303638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.304252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.304542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.304824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.305527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.307176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.311986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:10.318982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 939/1849] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:10.323211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.333669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5708f48-2a74-4bc5-8fc5-aeb184cefaf4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.339030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.339702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.339990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.340271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.340971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.342608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd5d7b-ca76-4dc5-b294-a0a17ea9a580 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.353837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 911/1850] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:10.358033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.368419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77450ba-d607-41ac-9582-9c40c8827110 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.373281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.374041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.374267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.374546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] PATH_INFO: `/v3/projects/dc53ab6815ff44d0a847529ade098e9a/users/24707c380f884dd389275e1a6c214005/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.389589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc53ab6815ff44d0a847529ade098e9a, user_id=24707c380f884dd389275e1a6c214005, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.392298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.489922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 940/1851] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:10 2022] PUT /identity/v3/projects/dc53ab6815ff44d0a847529ade098e9a/users/24707c380f884dd389275e1a6c214005/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:10.502377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.502777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.503045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.546887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] MFA Rules not processed for user `24707c380f884dd389275e1a6c214005`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:10.546887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:10.637103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 912/1852] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:10.640264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.764040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cb0d-3521-4e89-937b-e6c4cbd1b165 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.769982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.770624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.770912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.771190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.772556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.774550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:10.899988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:10.909464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 941/1853] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:10 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:10.910743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:10.922215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce42bf-9f58-4522-8a00-08ec0933123c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:10.984789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:10.985805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:10.985805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:10.991641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:10.991641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:10.991641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.066481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 913/1854] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:10 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:11.073510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:11.086025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d99bcf-2eff-4337-8e03-e7387faf4918 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:11.091176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:11.092318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.092318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.092698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.093278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:11.095001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.106617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 942/1855] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:11.110824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:11.122104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27649f3e-c2c8-407c-8daa-e1a1c5efae0a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:11.127208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:11.128010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.128306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.131903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] PATH_INFO: `/v3/projects/7ddafcaf2012454eabe2e73544d430c0/users/b651c4f21b99466ca819cdd53b0c7feb/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.164216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddafcaf2012454eabe2e73544d430c0, user_id=b651c4f21b99466ca819cdd53b0c7feb, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:11.166970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.209050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:11.243855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 914/1856] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:11 2022] PUT /identity/v3/projects/7ddafcaf2012454eabe2e73544d430c0/users/b651c4f21b99466ca819cdd53b0c7feb/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:11.248093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:11.259076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d32-b028-42b0-8d47-61060dfc504b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:11.325839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:11.326551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.326846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.327216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.328197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:11.329971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076a663-6e28-4afc-bb02-76563ba852d0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.341841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 943/1857] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:11.346101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:11.357614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804de86-8c60-4683-8c28-5b4b47ce4959 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:11.362724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:11.363394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.363677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.364007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] PATH_INFO: `/v3/projects/7ddafcaf2012454eabe2e73544d430c0/users/b651c4f21b99466ca819cdd53b0c7feb/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.367193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddafcaf2012454eabe2e73544d430c0, user_id=b651c4f21b99466ca819cdd53b0c7feb, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:11.370103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.381608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 915/1858] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:11 2022] PUT /identity/v3/projects/7ddafcaf2012454eabe2e73544d430c0/users/b651c4f21b99466ca819cdd53b0c7feb/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:11.391919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.392223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.392506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.443126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] MFA Rules not processed for user `b651c4f21b99466ca819cdd53b0c7feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:11.443126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:11.505049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 944/1859] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:11.519119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:11.520913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:11.579397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eb9b-bce4-4698-9571-a063c55b4ca3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:11.583111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:11.583737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:11.584045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:11.584672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:11.594187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:11.595604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:11.606845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 916/1860] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:13.780732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:13.989823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:13.992405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:14.004917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a031-b8f9-4d2d-a203-dd66036f3b50 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:14.009458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:14.010133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:14.010424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:14.010700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:14.078285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:14.078853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75efb-f7d2-4def-84aa-201f8076c66e service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:14.088922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 945/1861] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:14.533965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:14.535386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:14.606707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1803d3-2930-46f4-94dd-e3d428485b50 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:14.612924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:14.613887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:14.614169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:14.614447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] PATH_INFO: `/v3/users/32a2707f1fcd4de9b6ff7ac24b7ff407` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:14.615792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a2707f1fcd4de9b6ff7ac24b7ff407)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:14.617850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:14.636432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:14.852140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a2707f1fcd4de9b6ff7ac24b7ff407'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:14.853272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a2707f1fcd4de9b6ff7ac24b7ff407'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:14.871412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a2707f1fcd4de9b6ff7ac24b7ff407'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:14.872179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a2707f1fcd4de9b6ff7ac24b7ff407'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:14.946521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a2707f1fcd4de9b6ff7ac24b7ff407'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:14.946826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:14.967883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 917/1862] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:14 2022] DELETE /identity/v3/users/32a2707f1fcd4de9b6ff7ac24b7ff407 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:14.972278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:14.972555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:14.973256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:14.999455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:15.000981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:15.099346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 946/1863] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:15.112995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:15.112995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:15.242363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7f4bf-45ef-4a98-bcce-def8e40bb224 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:15.246842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:15.247951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:15.247951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:15.248142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:15.262808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:15.265048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:15.279168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 918/1864] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:16.086545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:16.088104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:16.112094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cf3f7-9a41-4aeb-8560-e7082363d82d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:16.119171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:16.120578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:16.120947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:16.121320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] PATH_INFO: `/v3/projects/efe71a942ea8478f9891c54a086976c8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:16.122813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe71a942ea8478f9891c54a086976c8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:16.125054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:16.258289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe71a942ea8478f9891c54a086976c8', 'request_id': 'req-bf8111c0-75df-43cf-af6f-4a1f896bada7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.266199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe71a942ea8478f9891c54a086976c8', 'request_id': 'req-bf8111c0-75df-43cf-af6f-4a1f896bada7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.274366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe71a942ea8478f9891c54a086976c8', 'request_id': 'req-bf8111c0-75df-43cf-af6f-4a1f896bada7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.370515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] The token cache is being invalidate because project efe71a942ea8478f9891c54a086976c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:16.371114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.372006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bf8111c0-75df-43cf-af6f-4a1f896bada7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.374031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 947/1865] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:16 2022] DELETE /identity/v3/projects/efe71a942ea8478f9891c54a086976c8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:16.379564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:16.395360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781e2b-7190-43c8-9fc0-e955ca916b7b service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:16.484467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:16.486259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:16.488185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:16.488688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] PATH_INFO: `/v3/users/fd146bae44b94cf590db09b525cf4c33` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:16.495893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd146bae44b94cf590db09b525cf4c33)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:16.504027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:16.844387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd146bae44b94cf590db09b525cf4c33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.844387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd146bae44b94cf590db09b525cf4c33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.848624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd146bae44b94cf590db09b525cf4c33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.849586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd146bae44b94cf590db09b525cf4c33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.893216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:16.909883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-13ae4b3e-8a55-4a25-bdb2-7082ccee2544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd146bae44b94cf590db09b525cf4c33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:16.928235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 919/1866] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:16 2022] DELETE /identity/v3/users/fd146bae44b94cf590db09b525cf4c33 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:16.944191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:16.944191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:16.946857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:16.946857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 948/1867] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:21:16.975694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:16.976453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:16.976453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:17.006315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:17.010179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:17.086796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 920/1868] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:21:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:17.107558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:17.109531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:17.129186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:17.139807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6016ee-f478-4ef4-935d-6297d7601a3d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:17.147485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:17.150570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:17.151709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:17.152328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:17.167967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:17.170986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b47aa-29dd-4d28-ab4d-6a239ff4844b service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:17.193650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 949/1869] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:17.499363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:17.504076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:17.637513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055762f-77f0-4b54-87b6-63990dfa8414 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:17.642455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:17.643123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:17.643410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:17.643692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] PATH_INFO: `/v3/projects/b2fdb3109d534a7c92f887665da3f11f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:17.645348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fdb3109d534a7c92f887665da3f11f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:17.647819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:17.782380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fdb3109d534a7c92f887665da3f11f', 'request_id': 'req-747349a0-1752-4cb3-87a7-847d7022fbe1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:17.794322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fdb3109d534a7c92f887665da3f11f', 'request_id': 'req-747349a0-1752-4cb3-87a7-847d7022fbe1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:17.801530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fdb3109d534a7c92f887665da3f11f', 'request_id': 'req-747349a0-1752-4cb3-87a7-847d7022fbe1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:17.905372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] The token cache is being invalidate because project b2fdb3109d534a7c92f887665da3f11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:17.905670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:17.910179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-747349a0-1752-4cb3-87a7-847d7022fbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:17.911833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 921/1870] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:17 2022] DELETE /identity/v3/projects/b2fdb3109d534a7c92f887665da3f11f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:17.917506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:17.918117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:17.918707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:17.956336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:17.958595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:18.064866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 950/1871] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:18.066364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.066778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.067161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.096534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:18.098077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:18.111469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 922/1872] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:18.112538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.135327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e825200-9c36-4d99-b7b4-e4ed5abbbaaf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.184489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.184489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.184489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.184489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.184821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:18.184821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.184821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.184821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 951/1873] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:21:18.186401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.196425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a307-08c8-49ad-b5b6-b5fe4c79fb4d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.204080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.204528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.206437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.206437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.206437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.207851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.315673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 923/1874] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:18.320686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.336562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eb3e-10e0-4267-a00a-9253830359f6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.415612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.416233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.416579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.416861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.417709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.419969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.575400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 952/1875] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:18 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:18.579625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.590042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214e2bb-45ff-4ab9-8d94-1cf88ae09369 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.594840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.595470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.595757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.596039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.596750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.598401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.609678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 924/1876] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:18.614261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.629603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a03b5e-cc4e-491d-be65-b210f1437419 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.635448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.636095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.636369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.636642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.637344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.638994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8209-3ca7-4b41-8566-1368813ff112 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.652433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 953/1877] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:18.656911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:18.667769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd5771-38d0-440d-ab57-ea24108b0950 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:18.672576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:18.673247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.676254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.676254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] PATH_INFO: `/v3/projects/74cb00d2fc7649829be901018b393446/users/18ed1952acaa4ff896b47e1fb263f48d/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.697113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cb00d2fc7649829be901018b393446, user_id=18ed1952acaa4ff896b47e1fb263f48d, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:18.699946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:18.775409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 925/1878] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:18 2022] PUT /identity/v3/projects/74cb00d2fc7649829be901018b393446/users/18ed1952acaa4ff896b47e1fb263f48d/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:18.786078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:18.786390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:18.786659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:18.825337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] MFA Rules not processed for user `18ed1952acaa4ff896b47e1fb263f48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:18.826691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:18.914336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 954/1879] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:18.917115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.008991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a6fba-d18b-4bda-8b3f-62d033e1c2c4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.014948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.015718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.016272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.016272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.017077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.019581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.144079 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:19.229213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 926/1880] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:19.230770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.245150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d51b1-c560-43c5-b8a8-6f7c98afcd6d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.371678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.375020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.375020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.375020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.375020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.378553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.515955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 955/1881] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:19 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:19.519961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.530604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c747-3326-41b3-95ae-8386741102bd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.533340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:19.536366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.538047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.538448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.538650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.539998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.542194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.564711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 927/1882] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:19.567784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.586318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214217-db54-47a3-af99-7e5d3f57f98c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.619375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.619375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.619375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.619375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] PATH_INFO: `/v3/projects/ab8a52dde03744afa46d53166665d6df/users/4258bae14a144e08a6b0dfd5936c8bf1/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.626626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8a52dde03744afa46d53166665d6df, user_id=4258bae14a144e08a6b0dfd5936c8bf1, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.629548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.758719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 956/1883] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:19 2022] PUT /identity/v3/projects/ab8a52dde03744afa46d53166665d6df/users/4258bae14a144e08a6b0dfd5936c8bf1/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:19.762541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.776036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cbc28-c961-495f-b1fb-6cdab7fb0142 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.862086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.862086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.862086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.862086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.863586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.864174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.875824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 928/1884] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:19.882546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.893307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a758d-dd0d-40a3-8958-65aed2ac73dc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:19.898233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:19.898910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.899199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.899481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] PATH_INFO: `/v3/projects/ab8a52dde03744afa46d53166665d6df/users/4258bae14a144e08a6b0dfd5936c8bf1/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.901434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8a52dde03744afa46d53166665d6df, user_id=4258bae14a144e08a6b0dfd5936c8bf1, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:19.904121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9823ff-7938-40fb-8c1d-5f5391aed5ef admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:19.919563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 957/1885] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:19 2022] PUT /identity/v3/projects/ab8a52dde03744afa46d53166665d6df/users/4258bae14a144e08a6b0dfd5936c8bf1/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:19.939194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:19.941966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:19.942165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:19.942538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:19.943188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:19.989907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] MFA Rules not processed for user `4258bae14a144e08a6b0dfd5936c8bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:19.993002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:20.006372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb9-8d1e-4703-b581-527962eb0756 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:20.067038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:20.068622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:20.069108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:20.069537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:20.071849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:20.128157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 958/1886] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:20.150692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:20.152654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:20.164496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 929/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:20.590062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:20.593089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:20.617779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd53b2-8b04-4b63-8857-06db6d70d664 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:20.624903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:20.625796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:20.626258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:20.629474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:20.718063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:20.718063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:20.721398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 959/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:21.089931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:21.323385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:28.279195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:28.288275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27c50e-2055-45d4-99bc-27e1e29c32c6 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:28.292102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:28.292728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:28.293006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:28.293282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:28.306852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:28.308205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612537-fae8-47e9-bd1a-74c05474101c service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:28.328115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 930/1889] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:29.926950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:29.928775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:29.997651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdec7c-9984-43f7-942a-d71c22f50cab service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:30.004498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:30.005470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:30.006058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:30.006475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] PATH_INFO: `/v3/users/7794dc091acb41c99022aef243adce65` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:30.007995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7794dc091acb41c99022aef243adce65)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:30.010104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:30.201723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7794dc091acb41c99022aef243adce65'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:30.202816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7794dc091acb41c99022aef243adce65'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:30.222592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7794dc091acb41c99022aef243adce65'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:30.235827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7794dc091acb41c99022aef243adce65'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:30.307553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7794dc091acb41c99022aef243adce65'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:30.321990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 960/1890] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:29 2022] DELETE /identity/v3/users/7794dc091acb41c99022aef243adce65 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:30.323491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:30.323958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:30.324054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:30.359520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:30.360753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:30.419456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:30.441791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 931/1891] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:30.454088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:30.456751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:30.516890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:30.529593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a3ea1-2f64-4e79-bf98-889c9688c748 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:30.533511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:30.534274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:30.534907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:30.538749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:30.553612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:30.556547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:30.569377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 961/1892] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:31.154834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:31.156755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:31.172958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719a273-8ddf-45fa-a80f-c9379a66a2ce None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:31.185984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:31.186835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:31.187868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:31.187868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] PATH_INFO: `/v3/projects/1bfa68843a0a420c9a7aca3c453b4ee2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:31.189658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfa68843a0a420c9a7aca3c453b4ee2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:31.192332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:31.356386 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfa68843a0a420c9a7aca3c453b4ee2', 'request_id': 'req-96b44839-0044-4eb1-a161-b5cb4c9848ac'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.364328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfa68843a0a420c9a7aca3c453b4ee2', 'request_id': 'req-96b44839-0044-4eb1-a161-b5cb4c9848ac'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.373112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfa68843a0a420c9a7aca3c453b4ee2', 'request_id': 'req-96b44839-0044-4eb1-a161-b5cb4c9848ac'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.483570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] The token cache is being invalidate because project 1bfa68843a0a420c9a7aca3c453b4ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:31.483925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.484995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.489292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 932/1893] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:31 2022] DELETE /identity/v3/projects/1bfa68843a0a420c9a7aca3c453b4ee2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:31.495001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:31.508997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d91fb-a033-4785-8a51-107aecb1dde3 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:31.604286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:31.605548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:31.606068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:31.606507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] PATH_INFO: `/v3/users/24707c380f884dd389275e1a6c214005` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:31.608646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24707c380f884dd389275e1a6c214005)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:31.611020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:31.839060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24707c380f884dd389275e1a6c214005'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.843732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24707c380f884dd389275e1a6c214005'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.852963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24707c380f884dd389275e1a6c214005'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.860127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24707c380f884dd389275e1a6c214005'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.939918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24707c380f884dd389275e1a6c214005'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:31.953009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 962/1894] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:31 2022] DELETE /identity/v3/users/24707c380f884dd389275e1a6c214005 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:32.421698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:32.423273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:32.439247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b44839-0044-4eb1-a161-b5cb4c9848ac admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:32.498899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:32.499601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:32.499894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:32.500175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] PATH_INFO: `/v3/projects/dc53ab6815ff44d0a847529ade098e9a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:32.501350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc53ab6815ff44d0a847529ade098e9a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:32.503293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:32.596123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc53ab6815ff44d0a847529ade098e9a', 'request_id': 'req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.602207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc53ab6815ff44d0a847529ade098e9a', 'request_id': 'req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.608314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc53ab6815ff44d0a847529ade098e9a', 'request_id': 'req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.611838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:32.688186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] The token cache is being invalidate because project dc53ab6815ff44d0a847529ade098e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:32.688467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.689109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.690753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 933/1895] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:32 2022] DELETE /identity/v3/projects/dc53ab6815ff44d0a847529ade098e9a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:32.695563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:32.697046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:32.710589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12674-c8d0-4074-bb42-2913bd5d628d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:32.774806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:32.775485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:32.776000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:32.776279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] PATH_INFO: `/v3/users/b651c4f21b99466ca819cdd53b0c7feb` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:32.777535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b651c4f21b99466ca819cdd53b0c7feb)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:32.779763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:32.789107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:32.975863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b651c4f21b99466ca819cdd53b0c7feb'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.976520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b651c4f21b99466ca819cdd53b0c7feb'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.988318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b651c4f21b99466ca819cdd53b0c7feb'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:32.997968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b651c4f21b99466ca819cdd53b0c7feb'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.074861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fee726b0-822e-471e-8740-4f887f1309f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b651c4f21b99466ca819cdd53b0c7feb'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.081710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 963/1896] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:32 2022] DELETE /identity/v3/users/b651c4f21b99466ca819cdd53b0c7feb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:33.513422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:33.515000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:33.528192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3c4e4-2f13-4ca4-94c1-ba3a49ec32cb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:33.591426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:33.592086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:33.595789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:33.595789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] PATH_INFO: `/v3/projects/7ddafcaf2012454eabe2e73544d430c0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:33.596476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddafcaf2012454eabe2e73544d430c0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:33.598459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:33.689160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddafcaf2012454eabe2e73544d430c0', 'request_id': 'req-ecb233ce-c789-4157-92cd-7b69d56b3d14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.694729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddafcaf2012454eabe2e73544d430c0', 'request_id': 'req-ecb233ce-c789-4157-92cd-7b69d56b3d14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.700866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddafcaf2012454eabe2e73544d430c0', 'request_id': 'req-ecb233ce-c789-4157-92cd-7b69d56b3d14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.762461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] The token cache is being invalidate because project 7ddafcaf2012454eabe2e73544d430c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:33.762657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.763360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecb233ce-c789-4157-92cd-7b69d56b3d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:33.764889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 934/1897] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:33 2022] DELETE /identity/v3/projects/7ddafcaf2012454eabe2e73544d430c0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:33.770914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:33.771363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:33.771504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:33.792016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:33.793222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:33.854101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 964/1898] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:33.862914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:33.863198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:33.863475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:33.884034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:33.885275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:33.893364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 935/1899] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:33.898225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:33.907974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8f43-44d7-4bf0-82d1-4d20a98acd57 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:33.913680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:33.914355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:33.914640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:33.914917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:33.915658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:33.915974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:33.917576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:33.930629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 965/1900] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:33.935475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:33.946290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12400329-3a56-4ad7-9395-d7a7228d2808 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:33.951461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:33.952199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:33.952590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:33.952939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:33.953702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:33.955738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.064735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 936/1901] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:33 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:34.069134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:34.080348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551173-1aba-491a-a5b4-fc471bd1d52e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:34.150136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:34.150803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.151142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.151429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.152249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:34.154235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.233020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:34.238570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 966/1902] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:34 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:34.244843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:34.257244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd881b-ce5d-41b3-bf83-5bf5c5abe2a7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:34.262905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:34.263777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.263897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.264113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.264815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:34.266599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.281796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 937/1903] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:34.283376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:34.294206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704db70-6fe8-4da0-88f5-d4e2b35b0c90 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:34.299055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:34.300080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.300379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.301042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.301988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:34.304315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2fd6-f0ed-4742-8b48-697dd153d9e6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.315693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 967/1904] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:34.319877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:34.329961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243b8f-ff89-44d9-b225-5ec6b11a58f6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:34.335515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:34.336202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.336491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.336773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] PATH_INFO: `/v3/projects/77f9effa11564a978cd4a37b246d7468/users/d53bb23f146f4077b2904cd968968a3b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.352902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f9effa11564a978cd4a37b246d7468, user_id=d53bb23f146f4077b2904cd968968a3b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:34.355925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.423983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 938/1905] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:34 2022] PUT /identity/v3/projects/77f9effa11564a978cd4a37b246d7468/users/d53bb23f146f4077b2904cd968968a3b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:34.436325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.436642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.436927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.465776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] MFA Rules not processed for user `d53bb23f146f4077b2904cd968968a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:34.467025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:34.537653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 968/1906] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:34.548828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:34.550659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:34.577952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:34.609070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644069d-f23a-4587-b8be-0ccca28d5386 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:34.613401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:34.614065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:34.614356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:34.614677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:34.624701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:34.626346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9d090-b110-4b6d-b597-625adf409618 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:34.636659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 939/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:42.369138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:42.439764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd5f66-3f75-43af-9530-1c106649ce9c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:42.445867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:42.446538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:42.446827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:42.447108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] PATH_INFO: `/v3/users/d53bb23f146f4077b2904cd968968a3b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:42.448330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53bb23f146f4077b2904cd968968a3b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:42.450336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:42.645490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53bb23f146f4077b2904cd968968a3b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:42.646344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53bb23f146f4077b2904cd968968a3b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:42.670791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53bb23f146f4077b2904cd968968a3b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:42.679759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53bb23f146f4077b2904cd968968a3b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:42.743672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53bb23f146f4077b2904cd968968a3b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:42.745622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:42.751039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 969/1908] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:42 2022] DELETE /identity/v3/users/d53bb23f146f4077b2904cd968968a3b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:42.755882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:42.756973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:42.757308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:42.778120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:42.779337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:42.842878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 940/1909] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:42.853669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:42.855443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:42.917258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b72710-b696-449d-aeb1-b89af5a9cba0 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:42.921343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:42.923337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:42.923337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:42.923337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:42.935747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:42.938169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eaec7a-66c7-4cae-8e51-8231a5583e53 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:42.949190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 970/1910] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:43.523475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:43.530263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:43.541364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150581-dd26-475a-b632-362b2da0d0a0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:43.546997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:43.548002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:43.548348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:43.548629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] PATH_INFO: `/v3/projects/77f9effa11564a978cd4a37b246d7468` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:43.550174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f9effa11564a978cd4a37b246d7468)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:43.554305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:43.691023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f9effa11564a978cd4a37b246d7468', 'request_id': 'req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:43.697555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f9effa11564a978cd4a37b246d7468', 'request_id': 'req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:43.703931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f9effa11564a978cd4a37b246d7468', 'request_id': 'req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:43.774552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] The token cache is being invalidate because project 77f9effa11564a978cd4a37b246d7468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:43.775092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:43.775526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:43.777185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 941/1911] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:43 2022] DELETE /identity/v3/projects/77f9effa11564a978cd4a37b246d7468 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:43.784290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb6a5-a9a1-4a0e-9393-11169cb12dbf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:43.786068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb6a5-a9a1-4a0e-9393-11169cb12dbf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:43.786353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb6a5-a9a1-4a0e-9393-11169cb12dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:43.792514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:43.794587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:43.808949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-79ebb6a5-a9a1-4a0e-9393-11169cb12dbf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:43.810234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-79ebb6a5-a9a1-4a0e-9393-11169cb12dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:43.870750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:43.888876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b2afb-a4fd-436f-92e2-aae45ef7afd4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:43.894054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:43.894715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:43.894999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:43.895278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] PATH_INFO: `/v3/users/8e60b0e1ed5d462bb872021df057b8e7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:43.897500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e60b0e1ed5d462bb872021df057b8e7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:43.899603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:43.900830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 971/1912] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:43.914389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:43.917500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:43.917500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:43.945141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:43.946446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:43.954539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 972/1913] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:43.958685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:43.968642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7930ca-64cc-4108-b50f-05fada66b1a1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:43.975821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:43.975821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:43.975821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:43.975821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:43.976430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:43.976737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:43.978583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:43.994674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 973/1914] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:21:44.000554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.011602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d193-b8eb-4a8a-9899-cc48dbe6f63b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.016630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.017250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.017571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.017912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.018641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.020527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.056924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e60b0e1ed5d462bb872021df057b8e7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:44.057633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e60b0e1ed5d462bb872021df057b8e7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:44.070573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e60b0e1ed5d462bb872021df057b8e7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:44.071322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e60b0e1ed5d462bb872021df057b8e7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:44.090535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 974/1915] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:43 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:44.094643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.096309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.134086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-81fe0f6e-b12e-4764-aedb-136850f58678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e60b0e1ed5d462bb872021df057b8e7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:44.148063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 942/1916] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:43 2022] DELETE /identity/v3/users/8e60b0e1ed5d462bb872021df057b8e7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:44.153066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.153367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.153656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.176781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:44.178945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.202248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f928e-d5d5-4c39-8a36-e17641f8ecbc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.212652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:44.280145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 943/1917] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:44.291550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.292269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.292581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.292694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.293029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.294146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.294607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.296106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.361919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515495-ee34-4dd6-80da-ce8e456a03d1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.366468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.367112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.367395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.367673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.377736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.379236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.391278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 944/1918] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:44.424950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 975/1919] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:44 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:44.429786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.448268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b6038-ab74-48d1-9eb5-3f799c35c649 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.460729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.462064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.462509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.463034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.465600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.469924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.485535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:44.500780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 945/1920] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:44.503265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.523623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c5b1-52a4-46c5-988b-6a4086e5d697 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.528524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.529182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.529469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.529772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.530540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.532101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f698f2-4f6d-43f4-af72-60e13b781f79 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.543773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 976/1921] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:44.548116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.558565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137628b-5326-4749-8fec-daf611d3367f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.563790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.564465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.564752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.565034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] PATH_INFO: `/v3/projects/b7709a436485440aace7c238ee8494f3/users/7b8a3143ec5c43218553903db10dedfb/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.585468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7709a436485440aace7c238ee8494f3, user_id=7b8a3143ec5c43218553903db10dedfb, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.586560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.662868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 946/1922] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:44 2022] PUT /identity/v3/projects/b7709a436485440aace7c238ee8494f3/users/7b8a3143ec5c43218553903db10dedfb/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:44.674531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.674827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.675150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.705422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] MFA Rules not processed for user `7b8a3143ec5c43218553903db10dedfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:44.706731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.739444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.744137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.805079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 977/1923] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:44.814616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.817058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.853724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797392d4-f0f4-413f-9871-40b83608e309 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.859466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.860318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.860494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.860731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] PATH_INFO: `/v3/users/2b3b8b7652fb4799ad92039f24f84648` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.862132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3b8b7652fb4799ad92039f24f84648)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.873894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.905723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc903523-8371-48b4-990a-237d6bc93261 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.909816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.910657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.911093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.911369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.920576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.922138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.933862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 978/1924] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:44.934056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:44.935193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:44.950781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561efd4-cb0a-4682-ae01-a43845fa8e4c service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:44.955423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:44.956100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:44.956355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:44.956703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] PATH_INFO: `/v3/projects/99f226fd34d040b9aec6bebb4a597c9f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:44.957921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f226fd34d040b9aec6bebb4a597c9f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:44.960794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:44.979697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:45.036566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3b8b7652fb4799ad92039f24f84648'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.037913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3b8b7652fb4799ad92039f24f84648'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.051466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3b8b7652fb4799ad92039f24f84648'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.052325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3b8b7652fb4799ad92039f24f84648'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.095322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f226fd34d040b9aec6bebb4a597c9f', 'request_id': 'req-d90e61f5-b94b-4f60-b571-60b249cbfe12'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.103083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f226fd34d040b9aec6bebb4a597c9f', 'request_id': 'req-d90e61f5-b94b-4f60-b571-60b249cbfe12'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.108754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f226fd34d040b9aec6bebb4a597c9f', 'request_id': 'req-d90e61f5-b94b-4f60-b571-60b249cbfe12'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.172003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-75e41039-df41-4554-973d-65481bfb6613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3b8b7652fb4799ad92039f24f84648'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.186262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 947/1925] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:44 2022] DELETE /identity/v3/users/2b3b8b7652fb4799ad92039f24f84648 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:45.190743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:45.191032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:45.191311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:45.212585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:45.213829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:45.230877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] The token cache is being invalidate because project 99f226fd34d040b9aec6bebb4a597c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:45.231598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.232355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.234425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 979/1926] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:44 2022] DELETE /identity/v3/projects/99f226fd34d040b9aec6bebb4a597c9f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:45.238166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:45.239567 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:45.300678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:45.318070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 948/1927] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:45.338761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:45.340145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:45.347496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e61f5-b94b-4f60-b571-60b249cbfe12 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:45.353258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:45.354287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:45.354287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:45.354550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] PATH_INFO: `/v3/users/8af4bacc1a1c444d90de6f380d12ca56` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:45.355777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af4bacc1a1c444d90de6f380d12ca56)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:45.357872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:45.407115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4fa35-a2d4-43c0-a15c-9737096abb86 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:45.410972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:45.411606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:45.411894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:45.412399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:45.422719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:45.424160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:45.437987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 949/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:21:45.535147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af4bacc1a1c444d90de6f380d12ca56'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.535942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af4bacc1a1c444d90de6f380d12ca56'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.553859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af4bacc1a1c444d90de6f380d12ca56'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.570308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af4bacc1a1c444d90de6f380d12ca56'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.688147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af4bacc1a1c444d90de6f380d12ca56'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:45.699422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 980/1929] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:45 2022] DELETE /identity/v3/users/8af4bacc1a1c444d90de6f380d12ca56 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:45.873204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:45.874851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:45.890286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbfba-58d9-4ea7-b21f-d56cf85644cf service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:45.960247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:45.960954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:45.961245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:45.961522 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] PATH_INFO: `/v3/projects/7074ac354cbe4cbe9c27d5e1dd52c3c9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:45.962891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7074ac354cbe4cbe9c27d5e1dd52c3c9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:45.964862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:46.066481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7074ac354cbe4cbe9c27d5e1dd52c3c9', 'request_id': 'req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.079316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7074ac354cbe4cbe9c27d5e1dd52c3c9', 'request_id': 'req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.086670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7074ac354cbe4cbe9c27d5e1dd52c3c9', 'request_id': 'req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.129483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:46.131104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:46.144926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807449af-47df-442d-bbd6-a0da00d18379 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:46.155707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] The token cache is being invalidate because project 7074ac354cbe4cbe9c27d5e1dd52c3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:46.156680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.157498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.159672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 950/1930] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:45 2022] DELETE /identity/v3/projects/7074ac354cbe4cbe9c27d5e1dd52c3c9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:46.165325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:46.166815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:46.169331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:46.201520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:46.215025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:46.216029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.216372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.216654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] PATH_INFO: `/v3/projects/8090a8e86c484ceb8d2982feccaa605c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.218109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8090a8e86c484ceb8d2982feccaa605c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:46.220064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:46.239810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85249f1-d3a2-4fb6-9dd7-3c8a7df8152e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:46.247317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:46.248131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.249853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.249853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] PATH_INFO: `/v3/users/6f23f1b82d3848aeb66aa0d7d6251c04` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.250166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f23f1b82d3848aeb66aa0d7d6251c04)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:46.252063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:46.371270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8090a8e86c484ceb8d2982feccaa605c', 'request_id': 'req-53d12470-4254-44b9-93e2-c433908d89a2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.378113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8090a8e86c484ceb8d2982feccaa605c', 'request_id': 'req-53d12470-4254-44b9-93e2-c433908d89a2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.384698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8090a8e86c484ceb8d2982feccaa605c', 'request_id': 'req-53d12470-4254-44b9-93e2-c433908d89a2'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.475911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] The token cache is being invalidate because project 8090a8e86c484ceb8d2982feccaa605c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:46.476356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.477142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-53d12470-4254-44b9-93e2-c433908d89a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.479132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 981/1931] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:46 2022] DELETE /identity/v3/projects/8090a8e86c484ceb8d2982feccaa605c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:46.484736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee3724-f56a-4524-9d85-29d14d8eb666 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.485227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee3724-f56a-4524-9d85-29d14d8eb666 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.485547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee3724-f56a-4524-9d85-29d14d8eb666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.488210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f23f1b82d3848aeb66aa0d7d6251c04'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.488889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f23f1b82d3848aeb66aa0d7d6251c04'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.504520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f23f1b82d3848aeb66aa0d7d6251c04'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.505528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f23f1b82d3848aeb66aa0d7d6251c04'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.509125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-71ee3724-f56a-4524-9d85-29d14d8eb666 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:46.510405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-71ee3724-f56a-4524-9d85-29d14d8eb666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:46.575627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 982/1932] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:46.583580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.584162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.584162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.604339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f23f1b82d3848aeb66aa0d7d6251c04'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:46.606355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:46.608024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:46.624363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 983/1934] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:46.627748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 951/1934] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:46 2022] DELETE /identity/v3/users/6f23f1b82d3848aeb66aa0d7d6251c04 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:46.631461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:46.642538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbe73e-6b3b-433a-a229-a0a2eb245ea4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:46.710743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:46.744645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b31200-4344-430b-8715-db57f520559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:46.745678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31200-4344-430b-8715-db57f520559b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.746382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31200-4344-430b-8715-db57f520559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.747033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b31200-4344-430b-8715-db57f520559b admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.748487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b31200-4344-430b-8715-db57f520559b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:46.749306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b31200-4344-430b-8715-db57f520559b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:46.751589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b31200-4344-430b-8715-db57f520559b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:46.769809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 984/1935] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:46.775698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:46.800013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d698-806f-4ba3-a9e9-40bb2f210edf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:46.805578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:46.806348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:46.806637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:46.806919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:46.807609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:46.809603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:46.928566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 952/1936] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:46 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:46.929863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b31200-4344-430b-8715-db57f520559b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:46.940346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b31200-4344-430b-8715-db57f520559b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.000942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.001565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.001890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.002172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.002838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.004762 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.062007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.064021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:47.077938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c02295-91eb-423c-ad9d-f7cdd6aade1a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.085144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.085668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.086034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.091486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] PATH_INFO: `/v3/projects/b087b0c4be52444da88bd7fd658d2572` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.091486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b087b0c4be52444da88bd7fd658d2572)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.091486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.121998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 985/1937] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:46 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:47.125776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.136584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef3a15-fe45-45ba-9740-9a6665fd0358 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.141134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.141738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.142063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.142342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.143034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.144664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.158074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 986/1938] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:47.166986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.177278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10571-e740-4911-b1f5-ba0a73a71dc3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.182869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.183483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.183768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.184045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.184747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.186423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.197134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 987/1939] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:47.201123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.211537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d828e9-2198-4f19-b237-5ad612027e06 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.216148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.216817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.217101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.217384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] PATH_INFO: `/v3/projects/e17ca6d8baeb4a8cb97cec3c4e6205fa/users/f271650efe0b4fc0af66658ef1c772db/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.232144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b087b0c4be52444da88bd7fd658d2572', 'request_id': 'req-50da92b6-4192-4e14-bcba-4d7aef75778c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:47.234293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ca6d8baeb4a8cb97cec3c4e6205fa, user_id=f271650efe0b4fc0af66658ef1c772db, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.237204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed10f-1c02-4648-af1a-4360857d83ff admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.242112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b087b0c4be52444da88bd7fd658d2572', 'request_id': 'req-50da92b6-4192-4e14-bcba-4d7aef75778c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:47.249395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b087b0c4be52444da88bd7fd658d2572', 'request_id': 'req-50da92b6-4192-4e14-bcba-4d7aef75778c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:47.319248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 988/1940] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:47 2022] PUT /identity/v3/projects/e17ca6d8baeb4a8cb97cec3c4e6205fa/users/f271650efe0b4fc0af66658ef1c772db/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:47.323069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166421-4570-4322-ac33-a126dd81666b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.323526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166421-4570-4322-ac33-a126dd81666b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.324013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45166421-4570-4322-ac33-a126dd81666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.343929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] The token cache is being invalidate because project b087b0c4be52444da88bd7fd658d2572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:47.344762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:47.348353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-50da92b6-4192-4e14-bcba-4d7aef75778c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:47.354718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 953/1941] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:47 2022] DELETE /identity/v3/projects/b087b0c4be52444da88bd7fd658d2572 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:47.356693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0785-7a1d-4454-933c-e170b8819c41 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.356982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0785-7a1d-4454-933c-e170b8819c41 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.357268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd0785-7a1d-4454-933c-e170b8819c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.357633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-45166421-4570-4322-ac33-a126dd81666b None None] MFA Rules not processed for user `f271650efe0b4fc0af66658ef1c772db`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:47.359908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-45166421-4570-4322-ac33-a126dd81666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:47.379552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2afd0785-7a1d-4454-933c-e170b8819c41 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:47.381536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2afd0785-7a1d-4454-933c-e170b8819c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:47.385853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:47.440747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 989/1942] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:47.446823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45166421-4570-4322-ac33-a126dd81666b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.448351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-45166421-4570-4322-ac33-a126dd81666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:47.464078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:47.469845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 954/1943] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:47.481478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.481799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.482129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.504332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:47.507654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:47.527277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 955/1944] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:47.531603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.543303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45166421-4570-4322-ac33-a126dd81666b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.551051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645daf8-179c-4977-95c7-6249352ff787 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.552190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.553580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.553999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.554359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.555160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.557375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.557673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.558350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.558639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.558917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.559628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:47.559932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.561802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.575620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 956/1945] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:21:47.580003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.590101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0502941-0039-4ac1-aa22-381e5179ad1b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.594819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.595440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.595724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.596003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.598134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.598723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.656052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 990/1946] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:47.658624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.719109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 957/1947] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:47.720364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.731907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964583f-133a-4a13-968f-67e7eaaebb2a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.816475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.817115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.817407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.817683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.819184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.821691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.823147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862aecd-2d10-49dd-abff-96545e90801c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.828824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.829781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.831956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.832545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.833326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.836682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.903975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 991/1948] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:47.909652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.909867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 958/1949] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:47 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:47.914555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.921699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455286a-4636-4a1c-8777-f256b0036cd6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.925688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e876b09-c251-4393-9ab2-dd1e93ebb0b7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.930003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.930970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.931534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.931868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.932009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.932526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.932672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.932823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.933088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.933820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.934919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.935487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.949078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 992/1950] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:47.952011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 959/1950] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:47.955094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.955584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:47.968499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2cb8-9586-481f-b861-764907e1afa0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.968644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4ebe-f55f-4be2-b65f-1a51720c51dc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:47.973371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.973672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:47.975640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.975640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.975640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.975861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:47.975861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:47.975861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] PATH_INFO: `/v3/projects/a02f03eff5f148169f025b5a7b5adf3f/users/9cabc7af46fe4132aa51d3f2f805a1f6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:47.976187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:47.977946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:47.989476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 960/1951] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:47.999654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02f03eff5f148169f025b5a7b5adf3f, user_id=9cabc7af46fe4132aa51d3f2f805a1f6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.000475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.002637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.011281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e00f1-9e8c-4c7c-a4c1-156dc49a1ce8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.016514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.017189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.017471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.017746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] PATH_INFO: `/v3/projects/49261baf381045e1b5100cc153b31339/users/12f8ec9891dc4af7bbd5bf70309a2cec/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.038085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49261baf381045e1b5100cc153b31339, user_id=12f8ec9891dc4af7bbd5bf70309a2cec, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.040914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc4c35-efbc-4863-838d-c5eb6c6da543 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.123192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:48.128791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 993/1952] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:47 2022] PUT /identity/v3/projects/a02f03eff5f148169f025b5a7b5adf3f/users/9cabc7af46fe4132aa51d3f2f805a1f6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:48.138302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.167622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 961/1953] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:47 2022] PUT /identity/v3/projects/49261baf381045e1b5100cc153b31339/users/12f8ec9891dc4af7bbd5bf70309a2cec/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:48.179275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.179699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.180178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.204092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:48.213708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] MFA Rules not processed for user `12f8ec9891dc4af7bbd5bf70309a2cec`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:48.214153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc1ef-080c-4119-b739-d00ac23aa185 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.214993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:48.276781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.277454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.277839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.278122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.278826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.280443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.284338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 962/1954] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:48.289084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.290933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 994/1955] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:48.294808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.300456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983092a-8480-465d-9aee-d1ce09429092 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.305230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230beb-f595-4c39-8f67-07f505df57ae admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.306326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.307010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.307298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.307581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.308261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.309990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.310253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.310637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.310944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.311205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] PATH_INFO: `/v3/projects/a02f03eff5f148169f025b5a7b5adf3f/users/9cabc7af46fe4132aa51d3f2f805a1f6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.313187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02f03eff5f148169f025b5a7b5adf3f, user_id=9cabc7af46fe4132aa51d3f2f805a1f6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.315910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290a07-3643-47e4-97aa-5293233b763d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.333570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 995/1956] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:48 2022] PUT /identity/v3/projects/a02f03eff5f148169f025b5a7b5adf3f/users/9cabc7af46fe4132aa51d3f2f805a1f6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:48.344147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.344435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.344939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.374637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] MFA Rules not processed for user `9cabc7af46fe4132aa51d3f2f805a1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:48.375872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:48.407155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 963/1957] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:48 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:48.408247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.450129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 996/1958] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:48.461921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.463373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:48.478385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbab67-2465-4be4-970c-f8590851a786 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.478584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:48.483653 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.484289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.484629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.485117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.485553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.487597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.535968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45918c1-e91e-4842-a909-77671b18af6c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.589588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.590384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.590693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.590982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.594925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 964/1959] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:48 2022] POST /identity/v3/users => generated 306 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:48.595940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.606950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10939732-8943-4d3a-b4dd-f2623593a2a9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.612179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.612578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.612862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.613142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.613879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.616222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.630501 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 965/1960] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:48.634090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.657787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f1eb9-0d65-4173-b987-fe2534094a24 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.672156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.673840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.674729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.675558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.675918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.676451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] PATH_INFO: `/v3/projects/889f73c2aac74544884b5dfaa443a488/users/4765980fc69d46b3b29048b3b4fd03ee/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.686671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 997/1961] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:21:48.699476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889f73c2aac74544884b5dfaa443a488, user_id=4765980fc69d46b3b29048b3b4fd03ee, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.702651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.717833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.743159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769944-f6fe-4bdf-808e-42583144d975 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.748801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.749820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.750117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.750398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] PATH_INFO: `/v3/users/f271650efe0b4fc0af66658ef1c772db` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.752598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f271650efe0b4fc0af66658ef1c772db)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.754903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.807713 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 966/1962] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:48 2022] PUT /identity/v3/projects/889f73c2aac74544884b5dfaa443a488/users/4765980fc69d46b3b29048b3b4fd03ee/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:48.812572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.848207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:48.885009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c4d18-96f5-44b2-b8fc-83bd41489287 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.892280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.892927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.893217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.893500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.894241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.895899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.907951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 967/1964] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:21:48.914118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:48.925394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8976e-0a23-42a0-b2e6-8c397f7ebee1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:48.933955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:48.934678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.934913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.935193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] PATH_INFO: `/v3/projects/889f73c2aac74544884b5dfaa443a488/users/4765980fc69d46b3b29048b3b4fd03ee/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.937208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=889f73c2aac74544884b5dfaa443a488, user_id=4765980fc69d46b3b29048b3b4fd03ee, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:48.939880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8462-2daf-4a35-8535-5776dc042a2d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:48.953822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 968/1965] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:48 2022] PUT /identity/v3/projects/889f73c2aac74544884b5dfaa443a488/users/4765980fc69d46b3b29048b3b4fd03ee/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:21:48.966185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f271650efe0b4fc0af66658ef1c772db'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:48.966953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f271650efe0b4fc0af66658ef1c772db'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:48.967207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:48.967497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:48.967777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:48.994967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f271650efe0b4fc0af66658ef1c772db'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:49.003799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f271650efe0b4fc0af66658ef1c772db'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:49.006959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:49.008976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] MFA Rules not processed for user `4765980fc69d46b3b29048b3b4fd03ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:49.014469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.109621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c4c8f1ad-aa89-4f0b-9aff-7c567d5b68b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f271650efe0b4fc0af66658ef1c772db'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:49.116504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 998/1966] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:48 2022] DELETE /identity/v3/users/f271650efe0b4fc0af66658ef1c772db => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:49.121619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:49.121954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:49.122367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 969/1967] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:49.122490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:49.134992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:49.143171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:49.144419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.212745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003a02d-38e9-4b4d-a8f1-704576f2bc5a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:49.222086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 999/1968] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:21:49.232559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:49.233936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.269996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:49.270775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:49.271263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:49.271535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:49.273670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.296934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8e75-62cd-452f-b5fc-c3d8bf2fc7d1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:49.300759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:49.302112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:49.303206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:49.303494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:49.317547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:49.319678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:49.330141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1000/1969] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:21:49.348418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:49.350649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:49.360328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 970/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:49.397132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:49.595009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:49.600080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.610484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cbc9-5b4f-4a7a-82c9-c03cd819bfab service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:49.614509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:49.616932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:49.617068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:49.617438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:49.619760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.687884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:49.689239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:49.699515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1001/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:49.842865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:49.844629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:49.880020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d841-1577-444d-a9e0-6cc498fbe604 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:49.888039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:49.889050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:49.889426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:49.890414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] PATH_INFO: `/v3/projects/e17ca6d8baeb4a8cb97cec3c4e6205fa` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:49.891941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17ca6d8baeb4a8cb97cec3c4e6205fa)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:49.897537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:50.051809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17ca6d8baeb4a8cb97cec3c4e6205fa', 'request_id': 'req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.059942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17ca6d8baeb4a8cb97cec3c4e6205fa', 'request_id': 'req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.067280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17ca6d8baeb4a8cb97cec3c4e6205fa', 'request_id': 'req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.156418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] The token cache is being invalidate because project e17ca6d8baeb4a8cb97cec3c4e6205fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:50.156739 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.157691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.159204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 971/1972] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:49 2022] DELETE /identity/v3/projects/e17ca6d8baeb4a8cb97cec3c4e6205fa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:50.163908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:50.176965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e8ab-a634-4f37-b91a-dc6c62039fe1 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:50.210411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:50.241988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:50.242675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:50.242959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:50.243241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] PATH_INFO: `/v3/users/9cabc7af46fe4132aa51d3f2f805a1f6` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:50.244678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cabc7af46fe4132aa51d3f2f805a1f6)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:50.246737 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:50.439532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cabc7af46fe4132aa51d3f2f805a1f6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.440230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cabc7af46fe4132aa51d3f2f805a1f6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.455099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cabc7af46fe4132aa51d3f2f805a1f6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.464418 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cabc7af46fe4132aa51d3f2f805a1f6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.590867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-1de583e7-9082-406b-bab3-720ef8eb8edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cabc7af46fe4132aa51d3f2f805a1f6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:50.597415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1002/1973] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:21:50 2022] DELETE /identity/v3/users/9cabc7af46fe4132aa51d3f2f805a1f6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:51.009908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.011514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:51.027150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a9a6-3fd3-4fef-a9f7-08b35f251e6f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.088270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.088922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.089234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.089530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] PATH_INFO: `/v3/projects/a02f03eff5f148169f025b5a7b5adf3f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.090709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02f03eff5f148169f025b5a7b5adf3f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.092660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.229173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:51.241063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02f03eff5f148169f025b5a7b5adf3f', 'request_id': 'req-7df6ab23-b863-4553-aa36-6fc1029b7ee2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:51.246835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02f03eff5f148169f025b5a7b5adf3f', 'request_id': 'req-7df6ab23-b863-4553-aa36-6fc1029b7ee2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:51.252827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02f03eff5f148169f025b5a7b5adf3f', 'request_id': 'req-7df6ab23-b863-4553-aa36-6fc1029b7ee2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:51.338728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] The token cache is being invalidate because project a02f03eff5f148169f025b5a7b5adf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:21:51.339020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:51.339635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7df6ab23-b863-4553-aa36-6fc1029b7ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:21:51.341167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 972/1974] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:21:51 2022] DELETE /identity/v3/projects/a02f03eff5f148169f025b5a7b5adf3f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:51.346303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.346780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.346888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.367623 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:51.368811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:51.447406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1003/1975] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:51.459078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.459373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.460184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.482757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:51.483969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:51.493267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 973/1976] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:51.499075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.509629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfadb-4cb6-42cd-ac3c-25350d5bfdfd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.514436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.515052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.515335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.515607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.516298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:21:51.516602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.518404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.538198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1004/1977] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:21:51.547078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.563546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49a30-e26c-43f9-8b40-8b16132f4ba0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.577499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.578325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.586293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.586293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.586293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.586293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.666799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 974/1978] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:51 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:51.670859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.680963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02410a6-88c7-4b59-a25b-1b8481e614e8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.723620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:51.742392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.743017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.743300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.743620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.744587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.746534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.846573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1005/1979] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:51 2022] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:51.850494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.862343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c008a7-5548-4667-9c24-b8571f3f0163 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.867672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.868295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.868581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.868860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.869863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.871452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.882647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 975/1980] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:51.886723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.896730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088fc0-a4bb-4c50-b68b-e39af570a8f3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.901234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.901885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.902170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.902442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.903130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.904707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46752011-f955-4434-94bc-dd9b5a485cd6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:51.914605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1006/1981] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:51.918853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:51.929745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7998a-e9e6-43d7-8311-0eda54a2e173 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:51.934437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:51.935164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:51.935456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:51.935736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] PATH_INFO: `/v3/projects/c5900ca1c23e49b89b0d79d084f63003/users/a7042c721b164b99b6f63bb234705736/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:51.951810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5900ca1c23e49b89b0d79d084f63003, user_id=a7042c721b164b99b6f63bb234705736, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:51.954519 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.060308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 976/1982] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:51 2022] PUT /identity/v3/projects/c5900ca1c23e49b89b0d79d084f63003/users/a7042c721b164b99b6f63bb234705736/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:52.074158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564535-94df-4abc-af87-04697f510fa3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.074432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564535-94df-4abc-af87-04697f510fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.074713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564535-94df-4abc-af87-04697f510fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.104292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-58564535-94df-4abc-af87-04697f510fa3 None None] MFA Rules not processed for user `a7042c721b164b99b6f63bb234705736`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:52.105457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-58564535-94df-4abc-af87-04697f510fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:52.174882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1007/1983] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:52.179661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.243054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b42f-eb81-41ef-8f13-462a55d5d001 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.248118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.248756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.249040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.249320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.250066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.251995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.342562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 977/1984] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:21:52 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:21:52.346814 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58564535-94df-4abc-af87-04697f510fa3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.361322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58564535-94df-4abc-af87-04697f510fa3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.423441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.424065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.424345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.424620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.425300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.427243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.574986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1008/1985] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:21:52 2022] POST /identity/v3/users => generated 309 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:21:52.579011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.590967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b29f-144c-4bd6-8256-926770d1d0c5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.596749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.597526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.597967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.598340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.599206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.601159 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.622580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 978/1986] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:52.623696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.642179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97688b2-c051-450a-9340-8a9af580de34 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.650266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.651339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.651815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.652276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] PATH_INFO: `/v3/projects/faa9b17455304749b719c5ecc87c26b0/users/21ab5c579cba4c239b8404e20d12170e/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.669817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa9b17455304749b719c5ecc87c26b0, user_id=21ab5c579cba4c239b8404e20d12170e, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.672501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.742316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1009/1987] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:52 2022] PUT /identity/v3/projects/faa9b17455304749b719c5ecc87c26b0/users/21ab5c579cba4c239b8404e20d12170e/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:52.743297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.754723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03584c4-f20e-4422-8f02-30d08264c41c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.804380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:52.839589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.840623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.840980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.841335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.842453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.844632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565557b-c6de-48e8-8d1c-783833c04a9b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.855932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 979/1988] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:21:52.860461 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:52.872255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb84b4-1969-4f12-8d72-e4f42f5f18c1 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:52.877464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:52.878407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.878767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.879121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] PATH_INFO: `/v3/projects/faa9b17455304749b719c5ecc87c26b0/users/21ab5c579cba4c239b8404e20d12170e/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.882304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa9b17455304749b719c5ecc87c26b0, user_id=21ab5c579cba4c239b8404e20d12170e, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:52.885315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:52.892769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:52.898410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1010/1989] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:21:52 2022] PUT /identity/v3/projects/faa9b17455304749b719c5ecc87c26b0/users/21ab5c579cba4c239b8404e20d12170e/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:21:52.908553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:52.908943 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:52.913521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:52.939422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] MFA Rules not processed for user `21ab5c579cba4c239b8404e20d12170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:21:52.940646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:53.012450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 980/1990] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:21:53.024026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:53.025746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:21:53.087183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a03c-4315-49c5-a89a-1a9944a14a5f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:53.090807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:53.091433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:53.091723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:53.092158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:53.102658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:53.104173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:53.114207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1011/1991] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:21:53.499096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:21:53.510026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94592d6-9033-41cd-9da7-23104212bed1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:21:53.514215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:21:53.515063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:21:53.515539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:21:53.515674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:21:53.592840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:21:53.594342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:21:53.605579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 981/1992] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:01.548306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:01.550198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:01.557725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:01.559244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:01.625395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd119a06-a9da-4cfc-94d0-bda74c7b4fcb service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:01.626268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:01.631360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:01.632029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:01.635449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:01.635449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] PATH_INFO: `/v3/users/18ed1952acaa4ff896b47e1fb263f48d` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:01.635449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ed1952acaa4ff896b47e1fb263f48d)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:01.636551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:01.645415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb269-6bce-4341-bca4-3bd361958110 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:01.651242 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:01.651901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:01.652249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:01.652531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] PATH_INFO: `/v3/users/12f8ec9891dc4af7bbd5bf70309a2cec` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:01.653895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f8ec9891dc4af7bbd5bf70309a2cec)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:01.657204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:01.784510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ed1952acaa4ff896b47e1fb263f48d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.785168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ed1952acaa4ff896b47e1fb263f48d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.798120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ed1952acaa4ff896b47e1fb263f48d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.806225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ed1952acaa4ff896b47e1fb263f48d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.817619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f8ec9891dc4af7bbd5bf70309a2cec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.818319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f8ec9891dc4af7bbd5bf70309a2cec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.838141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f8ec9891dc4af7bbd5bf70309a2cec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.838959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f8ec9891dc4af7bbd5bf70309a2cec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.891800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7a9ab3ce-a98d-47b5-b5e2-6d549abf5414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ed1952acaa4ff896b47e1fb263f48d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.900337 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1012/1993] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:01 2022] DELETE /identity/v3/users/18ed1952acaa4ff896b47e1fb263f48d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:01.906977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:01.907166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:01.907315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:01.927608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:01.928770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:01.949665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:01.960069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-79f07b05-fc89-4869-b00b-d8c2bcf89e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f8ec9891dc4af7bbd5bf70309a2cec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:01.980416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 982/1994] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:01 2022] DELETE /identity/v3/users/12f8ec9891dc4af7bbd5bf70309a2cec => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:01.985706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:01.986720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:01.986720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:02.003548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1013/1995] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:02.009710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:02.010608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:02.014707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:02.016296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:02.088867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 983/1996] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:02.096460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7207c8-a446-43ed-b411-588f42e96eb0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:02.099051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:02.160726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:02.161379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:02.161666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:02.161972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:02.189960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:02.191586 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:02.192808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdf1b4-e90a-4aae-8f23-c611e565a239 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:02.197863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:02.198588 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:02.198889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:02.199169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:02.202784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1014/1997] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:02.217489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:02.219098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:02.239725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 984/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:02.683872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:02.685412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:02.701813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6855c-8442-4380-99ba-01ecf849cdf6 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:02.707460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:02.708098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:02.708437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:02.708778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] PATH_INFO: `/v3/projects/74cb00d2fc7649829be901018b393446` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:02.710077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cb00d2fc7649829be901018b393446)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:02.712668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:02.781896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:02.783320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:02.800004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275abc0-1f94-4f36-9195-b7d6bcd7c58d service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:02.810704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:02.810704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:02.810704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:02.810704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] PATH_INFO: `/v3/projects/49261baf381045e1b5100cc153b31339` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:02.811538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49261baf381045e1b5100cc153b31339)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:02.812570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:02.821859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:02.823268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cb00d2fc7649829be901018b393446', 'request_id': 'req-c855f0da-74e2-4d1c-b089-0058d8b16b79'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.829848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cb00d2fc7649829be901018b393446', 'request_id': 'req-c855f0da-74e2-4d1c-b089-0058d8b16b79'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.836078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cb00d2fc7649829be901018b393446', 'request_id': 'req-c855f0da-74e2-4d1c-b089-0058d8b16b79'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.921068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] The token cache is being invalidate because project 74cb00d2fc7649829be901018b393446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:02.921378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.922095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.923627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1015/1999] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:02 2022] DELETE /identity/v3/projects/74cb00d2fc7649829be901018b393446 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:02.927539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:02.928843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:02.933304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49261baf381045e1b5100cc153b31339', 'request_id': 'req-35b05588-a19e-473f-b831-e7e37d3e5892'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.936974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:02.940038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49261baf381045e1b5100cc153b31339', 'request_id': 'req-35b05588-a19e-473f-b831-e7e37d3e5892'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.947573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49261baf381045e1b5100cc153b31339', 'request_id': 'req-35b05588-a19e-473f-b831-e7e37d3e5892'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.995661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] The token cache is being invalidate because project 49261baf381045e1b5100cc153b31339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:02.996153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.996806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855f0da-74e2-4d1c-b089-0058d8b16b79 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:02.996970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:02.998921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 985/2000] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:02 2022] DELETE /identity/v3/projects/49261baf381045e1b5100cc153b31339 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:03.002851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:03.004161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:03.054366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:03.054921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:03.055206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:03.055485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] PATH_INFO: `/v3/users/4258bae14a144e08a6b0dfd5936c8bf1` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:03.056885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4258bae14a144e08a6b0dfd5936c8bf1)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:03.059704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:03.069353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05588-a19e-473f-b831-e7e37d3e5892 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:03.074822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:03.075474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:03.075764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:03.076078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] PATH_INFO: `/v3/users/4765980fc69d46b3b29048b3b4fd03ee` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:03.077251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4765980fc69d46b3b29048b3b4fd03ee)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:03.079718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:03.276666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4258bae14a144e08a6b0dfd5936c8bf1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.277342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4258bae14a144e08a6b0dfd5936c8bf1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.289299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4258bae14a144e08a6b0dfd5936c8bf1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.296106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4258bae14a144e08a6b0dfd5936c8bf1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.307342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4765980fc69d46b3b29048b3b4fd03ee'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.307912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4765980fc69d46b3b29048b3b4fd03ee'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.320558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4765980fc69d46b3b29048b3b4fd03ee'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.321355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4765980fc69d46b3b29048b3b4fd03ee'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.418856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4258bae14a144e08a6b0dfd5936c8bf1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.425415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1016/2001] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:02 2022] DELETE /identity/v3/users/4258bae14a144e08a6b0dfd5936c8bf1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:03.482300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4765980fc69d46b3b29048b3b4fd03ee'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:03.496941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 986/2002] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:03 2022] DELETE /identity/v3/users/4765980fc69d46b3b29048b3b4fd03ee => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:03.909935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:03.911460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:03.951294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:03.980076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:03.981816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:03.984214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ee77-262c-4290-aef7-0e43fba561e7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.005115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:04.048187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.048832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.049114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.049391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] PATH_INFO: `/v3/projects/ab8a52dde03744afa46d53166665d6df` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.050568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8a52dde03744afa46d53166665d6df)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.052474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.057800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e502-0eb8-4377-a796-507039472f54 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.063103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.063816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.064101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.064383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] PATH_INFO: `/v3/projects/889f73c2aac74544884b5dfaa443a488` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.065569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889f73c2aac74544884b5dfaa443a488)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.067520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.162784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8a52dde03744afa46d53166665d6df', 'request_id': 'req-fdad9288-ac93-4373-8e53-e62b1c33d47f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.169447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8a52dde03744afa46d53166665d6df', 'request_id': 'req-fdad9288-ac93-4373-8e53-e62b1c33d47f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.175316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8a52dde03744afa46d53166665d6df', 'request_id': 'req-fdad9288-ac93-4373-8e53-e62b1c33d47f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.189421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889f73c2aac74544884b5dfaa443a488', 'request_id': 'req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.194886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889f73c2aac74544884b5dfaa443a488', 'request_id': 'req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.200886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889f73c2aac74544884b5dfaa443a488', 'request_id': 'req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.280719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] The token cache is being invalidate because project ab8a52dde03744afa46d53166665d6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:04.281016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.281655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fdad9288-ac93-4373-8e53-e62b1c33d47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.283208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1017/2003] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:03 2022] DELETE /identity/v3/projects/ab8a52dde03744afa46d53166665d6df => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:04.287740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9f6a-8453-40a9-ac25-03407619e00c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.288031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9f6a-8453-40a9-ac25-03407619e00c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.288336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d9f6a-8453-40a9-ac25-03407619e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.308346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f43d9f6a-8453-40a9-ac25-03407619e00c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:04.312554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f43d9f6a-8453-40a9-ac25-03407619e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:04.344001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] The token cache is being invalidate because project 889f73c2aac74544884b5dfaa443a488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:04.344344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.344946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c9646ad3-ebcb-44df-b8bb-9850a6255ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:04.346558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 987/2004] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:03 2022] DELETE /identity/v3/projects/889f73c2aac74544884b5dfaa443a488 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:04.351337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41ba2-5324-4bcb-9196-2dbca2627e7f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.352245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41ba2-5324-4bcb-9196-2dbca2627e7f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.352536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41ba2-5324-4bcb-9196-2dbca2627e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.372334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1018/2005] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:04.372730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ecf41ba2-5324-4bcb-9196-2dbca2627e7f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:04.374055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ecf41ba2-5324-4bcb-9196-2dbca2627e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:04.380499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.380790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.381069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.382852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 988/2006] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:04.390768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.391099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.391389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.401928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:04.403614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:04.412014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1019/2007] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:04.414125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:04.415367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:04.417172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.421724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:04.424864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 989/2008] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:04.427411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd0c90-e074-4521-bdb5-17bf45b3aa2e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.429294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.433111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.433875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.434213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.437539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.437539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:04.437539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.437539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.438499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0f5c-1b66-449c-ad4c-49193f323651 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.443469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.444103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.444420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.445316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.446130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:04.446456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.448044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.453687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1020/2009] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:04.454452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.462505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 990/2010] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:04.465367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.470041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62907c0e-b583-4aca-b20e-7adb30e91a4b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.475431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808078e6-78ab-477c-8b46-4de792a214f7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.475575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.477152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.477547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.478021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.478790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.480544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.480721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.481158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.481452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.481736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.483642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.484299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.588886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1021/2011] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:04.590162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.596073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 991/2012] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:04.600135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.667322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee301c-abe0-4f37-b59a-aa8d8ebca28a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.670283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:04.672524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.673149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.673432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.673711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.674412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.676215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1943e-deb6-4763-a6bb-2da0880a0027 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.676403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.681992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.684568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.684568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.684568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.684568 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.686695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.795770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1022/2013] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:04.799862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.810665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8320-3147-4ba9-8a8c-130b1fc82d15 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.815898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.816487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.816770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.817048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.817733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.819335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.831982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 992/2014] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:04.832189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1023/2015] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:04.834013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.834129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.844635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634f54-4795-4021-b754-aaa62fbb7a52 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.844803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bcb5e-f45d-47f4-8661-f4c55aa0f644 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.849410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.850052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.850181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.850345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.850627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.850746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.851644 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.851930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.852051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.852628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.853489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.854382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.864470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1024/2016] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:04.867755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 993/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:04.868569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.871697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.879051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a166fb-0969-4b00-97bf-42d5e36d7ddc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.881469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2241-d02e-4250-8b90-02c45522afaf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.883984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.884674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.884968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.885249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] PATH_INFO: `/v3/projects/4a6ae4dd17ce42bcb7f1a687502f751a/users/687ec6a81c6e4789a7341a3aae99d057/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.886468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.887180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.887375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.887670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.888341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.890172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.902117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 994/2018] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:04.903592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6ae4dd17ce42bcb7f1a687502f751a, user_id=687ec6a81c6e4789a7341a3aae99d057, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.906306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:04.908186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017309d0-d59a-49d0-b8c9-d48a6dc3500b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.916935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5902737-f96d-43df-a657-4e881808b161 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:04.922045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:04.922646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.922929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.923206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] PATH_INFO: `/v3/projects/9f24bfe8760e47a1b135ff66aad39334/users/9a9bdb18a1094f41847c3d815e103361/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.937877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f24bfe8760e47a1b135ff66aad39334, user_id=9a9bdb18a1094f41847c3d815e103361, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:04.940551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7374-ba22-4758-b531-c3fd7f067bc2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:04.973869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1025/2019] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:04 2022] PUT /identity/v3/projects/4a6ae4dd17ce42bcb7f1a687502f751a/users/687ec6a81c6e4789a7341a3aae99d057/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:04.985929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:04.986219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:04.986497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:04.995219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 995/2020] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:04 2022] PUT /identity/v3/projects/9f24bfe8760e47a1b135ff66aad39334/users/9a9bdb18a1094f41847c3d815e103361/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:05.005556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.005878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.006201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.015233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] MFA Rules not processed for user `687ec6a81c6e4789a7341a3aae99d057`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:05.020424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:05.035132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] MFA Rules not processed for user `9a9bdb18a1094f41847c3d815e103361`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:05.036384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:05.077747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:05.081711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1026/2021] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:05.086886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.101227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 996/2022] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:05.105695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.151775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcbb56-35af-4ad2-96cc-f859f165f66c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.156574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.157201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.157471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.157770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.158463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.160355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.168595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ee4b-04bd-4613-a1a5-af582b97dddd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.173341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.173915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.174206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.174488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.175153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.177048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.247877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1027/2023] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:05.251901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.269904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 997/2024] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:05.274474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.291788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:05.317336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e7d9-b828-4825-8b18-9fd20bd40fc1 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.337647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428f9d-81ca-46f5-92a4-f79316a9c14a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.343936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.344919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.345220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.345591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.346421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.348576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.386735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.390906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.390906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.390906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.390906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.390906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.462774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 998/2025] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:05.462950 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1028/2026] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:05.464358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.464476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.474136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8174-9916-4bbd-b586-71d8af8f7ce7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.474294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346664-6fef-451f-a4e2-222ea7e6fc35 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.479064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.479454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.479676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.479967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.480051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.480252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.480419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.480872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.480982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.481342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.482671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.482959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.495240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1029/2027] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:05.498305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 999/2028] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:05.499182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.499647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.514045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158315-339b-4ff1-b2ea-26b95f2c0685 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.514199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9588d-99fa-414f-9edc-b477d7d306a2 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.516479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.517298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.517627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.517893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] PATH_INFO: `/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56/users/0ebd2c60ab724a8e9c4b2df9fe8154a7/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.519606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.520657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.520958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.522052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] PATH_INFO: `/v3/projects/7f68b94444d64209a298a0848a85c030/users/336446b836be417caeab9f94ad02e863/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.532519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:05.539974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5164a2dc377e480aa7a9f9cce9a0ce56, user_id=0ebd2c60ab724a8e9c4b2df9fe8154a7, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.541271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f68b94444d64209a298a0848a85c030, user_id=336446b836be417caeab9f94ad02e863, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.543308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.544656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.627755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1030/2029] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:05 2022] PUT /identity/v3/projects/7f68b94444d64209a298a0848a85c030/users/336446b836be417caeab9f94ad02e863/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:05.629419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1000/2030] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:05 2022] PUT /identity/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56/users/0ebd2c60ab724a8e9c4b2df9fe8154a7/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:05.634085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.634219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.710820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41dd0-418b-46ef-8731-190757e071e2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.718766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.724098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b73d4e-53f7-408c-8522-2c846987d89a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.727233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.727525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.727807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.728531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.730200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.732423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.733522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.733843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.734129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.734840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.738332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.741257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1001/2031] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:05.746598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.750320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1031/2032] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:05.756383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.757838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7422-9f6c-465f-855a-96710dd30b2c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.769832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34236-f24d-4136-a305-01ace65bcd81 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:05.770777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.771753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.772197 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.773540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] PATH_INFO: `/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56/users/0ebd2c60ab724a8e9c4b2df9fe8154a7/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.776427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:05.777211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.778839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.782290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] PATH_INFO: `/v3/projects/7f68b94444d64209a298a0848a85c030/users/336446b836be417caeab9f94ad02e863/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.782290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f68b94444d64209a298a0848a85c030, user_id=336446b836be417caeab9f94ad02e863, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.785456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5164a2dc377e480aa7a9f9cce9a0ce56, user_id=0ebd2c60ab724a8e9c4b2df9fe8154a7, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:05.788261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc0de-6638-44d4-8e77-d775abef9740 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.796157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60500ea6-17a1-4eb2-8917-9c5bca849f7f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:05.803053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1002/2033] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:05 2022] PUT /identity/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56/users/0ebd2c60ab724a8e9c4b2df9fe8154a7/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:05.814636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1032/2034] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:05 2022] PUT /identity/v3/projects/7f68b94444d64209a298a0848a85c030/users/336446b836be417caeab9f94ad02e863/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:05.821225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.821422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:05.821523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.821610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:05.821717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.821844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:05.871792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] MFA Rules not processed for user `0ebd2c60ab724a8e9c4b2df9fe8154a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:05.873038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:05.876704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] MFA Rules not processed for user `336446b836be417caeab9f94ad02e863`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:05.878518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:05.927062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:05.959827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1003/2035] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:05.972124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:05.974584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:05.985376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1033/2036] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:06.042375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d552d-6a23-41d7-9ab9-8dcc440694b9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:06.046156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:06.046779 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:06.047060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:06.047334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:06.056784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:06.058241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:06.067465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1004/2037] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:06.092457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:06.102502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f2a4d-0d37-49bf-ad94-90bf4381249c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:06.106164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:06.106771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:06.107137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:06.107335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:06.165084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:06.168920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:06.170549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:06.180171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1034/2038] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:07.205583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:07.277556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f648-1373-47aa-b35f-2d49167c3fe0 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:07.282922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:07.283593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.284011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.284329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] PATH_INFO: `/v3/users/9a9bdb18a1094f41847c3d815e103361` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.285520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9bdb18a1094f41847c3d815e103361)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:07.287615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:07.308952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:07.310384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:07.328166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60731d-0c2e-466f-ab0f-0120267a437d service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:07.332817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:07.333466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.333828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.334107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] PATH_INFO: `/v3/users/a7042c721b164b99b6f63bb234705736` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.335865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7042c721b164b99b6f63bb234705736)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:07.338390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:07.526962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9bdb18a1094f41847c3d815e103361'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.527441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7042c721b164b99b6f63bb234705736'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.528104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7042c721b164b99b6f63bb234705736'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.528428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9bdb18a1094f41847c3d815e103361'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.543408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9bdb18a1094f41847c3d815e103361'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.544191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9bdb18a1094f41847c3d815e103361'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.545496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7042c721b164b99b6f63bb234705736'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.554090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7042c721b164b99b6f63bb234705736'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.619317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-497b8a84-500f-47c4-9be2-51938ace83f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9bdb18a1094f41847c3d815e103361'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.634707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:07.640721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1005/2039] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:07 2022] DELETE /identity/v3/users/9a9bdb18a1094f41847c3d815e103361 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:07.642380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.643451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.643830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.667698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:07.669020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:07.699293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-9eb9e3e8-5f65-4fd2-b7a3-83da5f3b3558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7042c721b164b99b6f63bb234705736'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:07.714518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1035/2040] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:07 2022] DELETE /identity/v3/users/a7042c721b164b99b6f63bb234705736 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:07.720407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.720890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.721274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.741570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1006/2041] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:07.745536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:07.746818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:07.755837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:07.758319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:07.817195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1036/2042] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:07.827626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214948-8bf5-4d63-ab61-b8fa8a728f10 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:07.829315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:07.879723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:07.880352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.880638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.880916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.892039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:07.893955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:07.910738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabbcbd-c936-4b56-a7ac-9308cce37b0b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:07.911602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1007/2043] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:07.915657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:07.916740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:07.917104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:07.917458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:07.932311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:07.934009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:07.946079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1037/2044] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:08.539412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:08.540980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:08.554582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e8559-be6e-45ae-adfc-ca104f1a4bc4 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:08.559618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:08.560269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:08.560553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:08.560833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] PATH_INFO: `/v3/projects/9f24bfe8760e47a1b135ff66aad39334` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:08.562036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f24bfe8760e47a1b135ff66aad39334)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:08.564794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:08.592437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:08.593875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:08.608306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425167e-ed92-4bb8-9de2-f1f317ec3be5 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:08.613646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:08.614389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:08.614773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:08.615149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] PATH_INFO: `/v3/projects/c5900ca1c23e49b89b0d79d084f63003` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:08.616448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5900ca1c23e49b89b0d79d084f63003)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:08.620359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:08.623324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:08.710249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f24bfe8760e47a1b135ff66aad39334', 'request_id': 'req-2c3c0785-cf89-4409-bec0-1a0155d711ad'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.722229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:08.730799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f24bfe8760e47a1b135ff66aad39334', 'request_id': 'req-2c3c0785-cf89-4409-bec0-1a0155d711ad'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.748238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5900ca1c23e49b89b0d79d084f63003', 'request_id': 'req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.750975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f24bfe8760e47a1b135ff66aad39334', 'request_id': 'req-2c3c0785-cf89-4409-bec0-1a0155d711ad'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.755409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5900ca1c23e49b89b0d79d084f63003', 'request_id': 'req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.768693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5900ca1c23e49b89b0d79d084f63003', 'request_id': 'req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.824675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] The token cache is being invalidate because project 9f24bfe8760e47a1b135ff66aad39334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:08.825172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.826037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:08.827850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1008/2045] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:08 2022] DELETE /identity/v3/projects/9f24bfe8760e47a1b135ff66aad39334 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:08.832446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:08.834173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:08.917465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0785-cf89-4409-bec0-1a0155d711ad admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:08.965108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:08.965678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:08.965991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:08.966269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] PATH_INFO: `/v3/users/0ebd2c60ab724a8e9c4b2df9fe8154a7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:08.967583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebd2c60ab724a8e9c4b2df9fe8154a7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:08.969662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:09.012183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] The token cache is being invalidate because project c5900ca1c23e49b89b0d79d084f63003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:09.012494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.013143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.014699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1038/2046] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:08 2022] DELETE /identity/v3/projects/c5900ca1c23e49b89b0d79d084f63003 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:09.018451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:09.019767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:09.033604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326d8c-0e99-47ed-bee3-15e9d15e7e1d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:09.039448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:09.040320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:09.040614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:09.040880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] PATH_INFO: `/v3/users/21ab5c579cba4c239b8404e20d12170e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:09.042187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ab5c579cba4c239b8404e20d12170e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:09.044125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:09.179142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebd2c60ab724a8e9c4b2df9fe8154a7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.179142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebd2c60ab724a8e9c4b2df9fe8154a7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.204200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebd2c60ab724a8e9c4b2df9fe8154a7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.204849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebd2c60ab724a8e9c4b2df9fe8154a7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.291622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ab5c579cba4c239b8404e20d12170e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.292168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ab5c579cba4c239b8404e20d12170e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.297241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebd2c60ab724a8e9c4b2df9fe8154a7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.310440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ab5c579cba4c239b8404e20d12170e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.319212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ab5c579cba4c239b8404e20d12170e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.320226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1009/2047] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:08 2022] DELETE /identity/v3/users/0ebd2c60ab724a8e9c4b2df9fe8154a7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:09.418067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ab5c579cba4c239b8404e20d12170e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:09.425265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1039/2048] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:09 2022] DELETE /identity/v3/users/21ab5c579cba4c239b8404e20d12170e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:09.943301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:09.951475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:09.970993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:10.047525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417373-2062-4c19-8547-cda72808792e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.055500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.059381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:10.116059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.117002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.117321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.117668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] PATH_INFO: `/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.119581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5164a2dc377e480aa7a9f9cce9a0ce56)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.121633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.143096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddccb2-d1d4-4747-9d55-0d532df41711 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.161958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.161958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.161958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.161958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] PATH_INFO: `/v3/projects/faa9b17455304749b719c5ecc87c26b0` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.162435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa9b17455304749b719c5ecc87c26b0)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.162435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.164181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:10.265976 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5164a2dc377e480aa7a9f9cce9a0ce56', 'request_id': 'req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.274047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5164a2dc377e480aa7a9f9cce9a0ce56', 'request_id': 'req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.284278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5164a2dc377e480aa7a9f9cce9a0ce56', 'request_id': 'req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.303333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa9b17455304749b719c5ecc87c26b0', 'request_id': 'req-0115e26c-fab0-49d2-b40e-7ade6f48745e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.313042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa9b17455304749b719c5ecc87c26b0', 'request_id': 'req-0115e26c-fab0-49d2-b40e-7ade6f48745e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.323206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa9b17455304749b719c5ecc87c26b0', 'request_id': 'req-0115e26c-fab0-49d2-b40e-7ade6f48745e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.398270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] The token cache is being invalidate because project 5164a2dc377e480aa7a9f9cce9a0ce56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:10.399332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.400421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24cb6076-f1aa-4a41-bac6-4f96c9fb7f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.402232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1010/2049] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:09 2022] DELETE /identity/v3/projects/5164a2dc377e480aa7a9f9cce9a0ce56 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:10.408432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198c33-e388-4b47-bafd-e3f8c929f63a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.408794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198c33-e388-4b47-bafd-e3f8c929f63a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.409029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48198c33-e388-4b47-bafd-e3f8c929f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.449670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-48198c33-e388-4b47-bafd-e3f8c929f63a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:10.449670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-48198c33-e388-4b47-bafd-e3f8c929f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:10.476743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] The token cache is being invalidate because project faa9b17455304749b719c5ecc87c26b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:10.476743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.478144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0115e26c-fab0-49d2-b40e-7ade6f48745e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:10.479366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1040/2050] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:10 2022] DELETE /identity/v3/projects/faa9b17455304749b719c5ecc87c26b0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:10.484247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dad6-5d6c-4503-843a-f7cf8c10773c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.484702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dad6-5d6c-4503-843a-f7cf8c10773c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.484991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dad6-5d6c-4503-843a-f7cf8c10773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.517347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1011/2051] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:10.526297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.526604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.526878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.550296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ea76dad6-5d6c-4503-843a-f7cf8c10773c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:10.553698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ea76dad6-5d6c-4503-843a-f7cf8c10773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:10.565131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:10.565902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1041/2052] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:10.567318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:10.574232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.574610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.574964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.587293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1012/2053] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:10.591684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.604202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1bba-add8-4ca3-bd1b-a3fa4f09d0e5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.604395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:10.605620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:10.613992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.613992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.614967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.615413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.616473 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:10.617164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.619372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.636688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1013/2054] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:10.641589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.646008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1042/2055] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:10.647508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.658673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aab2b-caf7-4b7c-8e1b-aae5490f81fb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.661506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879d1e1-954d-41be-9abc-38808bccc737 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.664498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.665267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.665571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.666129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.666799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.669490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.669933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.676440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.690109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1043/2056] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:10.696104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.707808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4850afd-25bc-42b5-965e-11f3d9a6371e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.713362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.714044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.714339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.714642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.715296 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.717206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.791098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1014/2057] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:10.795574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.862902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480583-d806-4205-a91b-83aebbb75a43 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.868676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.869795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.870076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.873630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.874321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.876291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:10.880826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1044/2058] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:10.884792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:10.980393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:10.983848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fd771-269c-4374-89fc-b3cc6d23010c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:10.994378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:10.995409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:10.995702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:10.995983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:10.996666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:10.999065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1015/2059] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:11.002634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.003029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.015256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0041-6341-4927-8e7a-be072c80abe9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.047285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.050282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.051709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.052151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.054661 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.058322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.071936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1016/2060] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:11.076017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.087975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648690e-d00a-4dc7-bbda-55b2d2fb108c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.095452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.095452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.095452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.095452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.095845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.097327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.117948 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1045/2061] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:10 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:11.122169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1017/2062] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:11.122666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.123108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.137261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18736a51-8187-4941-9e19-ec861c1c6d82 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.137835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ab80-4433-4517-b6a1-bc0c1f8cd517 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.142649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.144090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.144090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.144279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.144380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] PATH_INFO: `/v3/projects/f0c999c6cc5c40adaab0bcd460f7a43a/users/7ecb17f8774d48e7beba7689bc3cf461/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.144855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.145387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.145778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.146621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.149398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.161160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c999c6cc5c40adaab0bcd460f7a43a, user_id=7ecb17f8774d48e7beba7689bc3cf461, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.164353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561f947-932e-444b-9d67-6e0076c3ad6c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.184957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1046/2063] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:11.186832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.197933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423494b-1478-4818-a522-334b16b2a83e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.203371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.204003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.204290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.204569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.205264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.206980 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.218880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1047/2064] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:11.223078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.233082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075fc56-34b3-44b2-a31e-eab996e28005 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.237825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.238485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.238768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.239044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] PATH_INFO: `/v3/projects/fe52fcb678a944d0a72847d116896d31/users/5b84088b6d594fd9879b04010e66f231/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.255591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe52fcb678a944d0a72847d116896d31, user_id=5b84088b6d594fd9879b04010e66f231, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.259056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef952-5757-4403-9a2f-8cad1f8992c0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.265449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1018/2065] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:11 2022] PUT /identity/v3/projects/f0c999c6cc5c40adaab0bcd460f7a43a/users/7ecb17f8774d48e7beba7689bc3cf461/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:11.276456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.276747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.277024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.304806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] MFA Rules not processed for user `7ecb17f8774d48e7beba7689bc3cf461`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.306278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.306584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:11.377981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1019/2066] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:11.390185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.391751 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.398934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1048/2067] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:11 2022] PUT /identity/v3/projects/fe52fcb678a944d0a72847d116896d31/users/5b84088b6d594fd9879b04010e66f231/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:11.413386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.416866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.416976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.500754 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] MFA Rules not processed for user `5b84088b6d594fd9879b04010e66f231`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.502112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.555352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0fca0-92d8-4b41-bd2a-082efe1a574a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.629377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1049/2068] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.634056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.659398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.662170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.663659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.664360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.733417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29790513-748e-43ce-a146-8573e6cad4ed None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.739582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.740530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.741189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.742383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.743400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.749791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.807000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.808457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.829882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1020/2069] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:11.854402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.865740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877075c-d9b8-4730-be83-59a8bff69a95 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.871299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.872022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.872523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.872676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] PATH_INFO: `/v3/users/7ecb17f8774d48e7beba7689bc3cf461` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.873894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecb17f8774d48e7beba7689bc3cf461)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.875942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.891891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1050/2070] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/projects => generated 367 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:11.896321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.965721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ead8d7-c593-4639-b7fe-168586ef93de admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.970571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.971199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.971488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.971771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.972439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.974414 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.110335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1051/2071] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:12.111529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.125796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9d6b8-8624-496d-881d-14c0be3db992 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.132992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.134001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.134368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.134719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.135578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.137630 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.139630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.145156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecb17f8774d48e7beba7689bc3cf461'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.148383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecb17f8774d48e7beba7689bc3cf461'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.158667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1052/2072] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.173960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.184707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecb17f8774d48e7beba7689bc3cf461'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.185509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecb17f8774d48e7beba7689bc3cf461'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.209483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496e20b-aa6c-4378-bd7b-77ebcebfdfe9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.219343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.220185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.221052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.221052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] PATH_INFO: `/v3/projects/6c525f1e719449ad8f7cd6ed9e200083/users/26d134ead7c34546a8c27c1d45cc6885/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.246372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c525f1e719449ad8f7cd6ed9e200083, user_id=26d134ead7c34546a8c27c1d45cc6885, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.249818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53dee7-0e06-4f24-85a9-1ed89fe081a6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.259298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecb17f8774d48e7beba7689bc3cf461'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.276204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1021/2073] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:11 2022] DELETE /identity/v3/users/7ecb17f8774d48e7beba7689bc3cf461 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:12.280055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.289716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.338790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1053/2074] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:12 2022] PUT /identity/v3/projects/6c525f1e719449ad8f7cd6ed9e200083/users/26d134ead7c34546a8c27c1d45cc6885/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:12.340828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.341122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.341464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.366742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.366964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbe778-180b-4326-ac5d-0b818c8a9b0a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.369173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.371010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.417686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.418508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.418857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.419200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.421104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.440343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1054/2075] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.457363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.458784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.474793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cf6f4-1166-4096-88db-0373c6c20d7b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.475651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.476719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.477009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.477424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.478766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.479895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.490394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1055/2076] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.492184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.495331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.505466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.507010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.518612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1022/2077] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:12.519446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.522390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.538763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ca7ae-d04f-416f-a222-0db4c7ab6c87 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.545497 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.546359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.546662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.547147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] PATH_INFO: `/v3/users/ea98d747777d42a5a9192dd2c4746038` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.548598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea98d747777d42a5a9192dd2c4746038)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.550717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.574840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b51c-c9aa-4c47-aef7-8b7be669618b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.582813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.583468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.583925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.584091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.604086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.606476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.620884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1056/2078] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:12.621871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.633657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba1894-94ad-4cd4-846c-d1fbe82fcaf3 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.640029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.640962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.641347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.641830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] PATH_INFO: `/v3/projects/6c525f1e719449ad8f7cd6ed9e200083/users/26d134ead7c34546a8c27c1d45cc6885/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.644240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c525f1e719449ad8f7cd6ed9e200083, user_id=26d134ead7c34546a8c27c1d45cc6885, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.648234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd429f9-0f70-488b-b5fc-c54a4763c3e1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.662649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1057/2079] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:12 2022] PUT /identity/v3/projects/6c525f1e719449ad8f7cd6ed9e200083/users/26d134ead7c34546a8c27c1d45cc6885/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:12.674082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.674416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.674720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.707462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] MFA Rules not processed for user `26d134ead7c34546a8c27c1d45cc6885`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.708750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.709005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.791207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1058/2080] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:12.802720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.804254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.833066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea98d747777d42a5a9192dd2c4746038'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.833854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea98d747777d42a5a9192dd2c4746038'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.859559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea98d747777d42a5a9192dd2c4746038'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.861049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea98d747777d42a5a9192dd2c4746038'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.866203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6c57-69ae-4265-bbb9-185500d4dc0e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.871362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.871982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.872266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.872539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.874786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.891271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.892983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.909319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1059/2081] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:12.928072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea98d747777d42a5a9192dd2c4746038'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:12.946007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1023/2082] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:12 2022] DELETE /identity/v3/users/ea98d747777d42a5a9192dd2c4746038 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:12.951027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.141286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.144693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.163057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.164983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.228125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e6702-39af-4775-8fcc-5e2a2165dc02 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.230057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b37f3-2d02-40d3-a883-cbca89f5861d service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.232338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.232998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.233337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.233615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.235581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.331009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.332502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.334170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.334824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.335253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.337911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] PATH_INFO: `/v3/projects/f0c999c6cc5c40adaab0bcd460f7a43a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.339187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c999c6cc5c40adaab0bcd460f7a43a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.341178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.342599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1024/2083] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:13.343409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.344729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.365423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eafef2-620b-46ef-963a-2767837e29f9 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.373835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.374645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.374931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.375315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] PATH_INFO: `/v3/projects/f351a73d1a584b2e9f51c4a86dfff0e3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.376833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f351a73d1a584b2e9f51c4a86dfff0e3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.378908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.464594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c999c6cc5c40adaab0bcd460f7a43a', 'request_id': 'req-aac7398c-73dd-41a7-b5b9-6470f0d6783d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.479236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c999c6cc5c40adaab0bcd460f7a43a', 'request_id': 'req-aac7398c-73dd-41a7-b5b9-6470f0d6783d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.489036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c999c6cc5c40adaab0bcd460f7a43a', 'request_id': 'req-aac7398c-73dd-41a7-b5b9-6470f0d6783d'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.527581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.544841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'request_id': 'req-96af0b2e-452a-44d2-8cdc-6e93c9905c12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.551024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'request_id': 'req-96af0b2e-452a-44d2-8cdc-6e93c9905c12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.559205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f351a73d1a584b2e9f51c4a86dfff0e3', 'request_id': 'req-96af0b2e-452a-44d2-8cdc-6e93c9905c12'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.600096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] The token cache is being invalidate because project f0c999c6cc5c40adaab0bcd460f7a43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:13.604293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.604293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-aac7398c-73dd-41a7-b5b9-6470f0d6783d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.604293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1060/2084] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:13 2022] DELETE /identity/v3/projects/f0c999c6cc5c40adaab0bcd460f7a43a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.608056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9ca0-551b-4364-9c33-0e879c04e85b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.608344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9ca0-551b-4364-9c33-0e879c04e85b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.608622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9ca0-551b-4364-9c33-0e879c04e85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.650915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-949d9ca0-551b-4364-9c33-0e879c04e85b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.652229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-949d9ca0-551b-4364-9c33-0e879c04e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.660601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] The token cache is being invalidate because project f351a73d1a584b2e9f51c4a86dfff0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:13.661430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.661899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96af0b2e-452a-44d2-8cdc-6e93c9905c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:13.668016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1025/2085] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:13 2022] DELETE /identity/v3/projects/f351a73d1a584b2e9f51c4a86dfff0e3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.671438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56505d4-619d-4af2-9fa6-2d26cf74ccdc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.671948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56505d4-619d-4af2-9fa6-2d26cf74ccdc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.672324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56505d4-619d-4af2-9fa6-2d26cf74ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.702498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a56505d4-619d-4af2-9fa6-2d26cf74ccdc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.703961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a56505d4-619d-4af2-9fa6-2d26cf74ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.712522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.762779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1061/2086] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:13.762779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.762779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.762779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.781848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1026/2087] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:13.787521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.787814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.788095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.793090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.793090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.800842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1062/2088] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:13.805822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.809058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.810349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.815209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585402d-3319-4bcc-8560-4af1da13f01b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.821131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1027/2089] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:13.821306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.821958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.822242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.822516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.823211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:13.823515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.825242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.825374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.836098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882609-d698-41f5-b73b-d2d3da512826 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.837445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1063/2090] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:13.841523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.842193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.842482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.842763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.843464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:13.843773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.845512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.850927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.869319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2f09c-e05c-4191-9410-4ebc1c60ae7e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.873230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1028/2091] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:13.878336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.880486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.881119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.881404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.881701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.883140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.885127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.889007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438907-3d66-45a6-9ad9-75603f8fb654 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.893664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.894329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.894609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.894887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.895538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.897396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.987439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1064/2092] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.988446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1029/2093] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.991226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.993315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.057007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86c78-4945-45ee-9bb7-53c0d44559f8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.066333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.067029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.067324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.067607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.067845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee08dc-c31e-4f69-8034-79cd291c5c22 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.068292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.070992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.073651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.074298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.074582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.074856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.075543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.077420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.159383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1065/2094] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:14.160376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.170635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc18bc-0ebf-4472-ad19-536efb6c6268 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.175271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.176015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.176341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.176595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.177278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.178970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.185686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1030/2095] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:14.189256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.190060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1066/2096] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.193531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.200850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196549a-eba7-45f2-b54e-80171871bd6c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.204494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776c74-0d12-427b-bd3f-7c9fdd988dee admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.206313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.206929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.207214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.207491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.208191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.208593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.210072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.217427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.218674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.219166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.219599 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.220471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.224306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1031/2097] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.224446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.225940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.238164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1067/2098] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:14.238332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0877b41-bd4a-4373-b4e3-7b1d1895bc2e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.246240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.246240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.246240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.246240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.246710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.247685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.250553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.260144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758b12d-4036-4162-8852-64f3c3b0bef3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.265571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1032/2099] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:14.265703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.266124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.266411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.271059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] PATH_INFO: `/v3/projects/f1330feed97f43c08fbf9525adeea900/users/afdc75134ecc4d26ab6c26de29f79d1b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.274794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.282443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1330feed97f43c08fbf9525adeea900, user_id=afdc75134ecc4d26ab6c26de29f79d1b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.284876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d8d6-04b3-431b-84f8-8b48849608e2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.285248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f9227-bbde-422d-a00b-2fc32ccfd4d1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.289550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.290246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.290529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.290948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] PATH_INFO: `/v3/projects/82274f1f4a344e3c87bc20035db644cc/users/a05e781b607f44abb5660b823071e913/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.305508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82274f1f4a344e3c87bc20035db644cc, user_id=a05e781b607f44abb5660b823071e913, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.308257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d52d4-a87e-4eb4-ab8b-ba11342e1e20 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.368422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1068/2100] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:14 2022] PUT /identity/v3/projects/f1330feed97f43c08fbf9525adeea900/users/afdc75134ecc4d26ab6c26de29f79d1b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:14.379142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.379437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.379719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.392072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1033/2101] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:14 2022] PUT /identity/v3/projects/82274f1f4a344e3c87bc20035db644cc/users/a05e781b607f44abb5660b823071e913/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:14.402393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.402681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.402961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.413833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] MFA Rules not processed for user `afdc75134ecc4d26ab6c26de29f79d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:14.415023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.431820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] MFA Rules not processed for user `a05e781b607f44abb5660b823071e913`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:14.433414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.484956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1069/2102] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:14.498322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.499881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.509093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1034/2103] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:14.522280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.523721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.580390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f2582-b22c-49a9-812e-6fd87de1fd2e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.581135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94ee0-49cc-4cba-8dd6-2fbb560de593 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.584307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.584866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.584994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.588955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.588955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.589168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.589168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.589168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.594028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.594626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.595428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.596067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b347543-d97a-4e9b-9eaf-759ccb8260ad service glance] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.604984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1035/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:14.605523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1070/2105] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:14.750898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:15.607651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:20.886076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:20.888427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.969961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b5a80-376b-4de5-8dd0-bfa43fc3e853 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:20.969961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:20.969961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.969961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.970334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] PATH_INFO: `/v3/users/5b84088b6d594fd9879b04010e66f231` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.970334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b84088b6d594fd9879b04010e66f231)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:20.970938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:20.984876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:21.205331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b84088b6d594fd9879b04010e66f231'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.206265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b84088b6d594fd9879b04010e66f231'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.224946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b84088b6d594fd9879b04010e66f231'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.225870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b84088b6d594fd9879b04010e66f231'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.292865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b84088b6d594fd9879b04010e66f231'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.311059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1036/2106] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:20 2022] DELETE /identity/v3/users/5b84088b6d594fd9879b04010e66f231 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:21.315620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:21.316113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:21.316330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:21.336667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:21.337987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:21.351660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:21.407028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1071/2107] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:21.417439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:21.419880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:21.484632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca7cc1-2980-4bfd-bec4-3346c5a0e34a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:21.488674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:21.489334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:21.489586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:21.490050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:21.502169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:21.504702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:21.521947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1037/2108] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:21.935369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:21.936766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:21.948702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484eaa7-afdb-4a4b-8473-08258a434336 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:21.953466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:21.954126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:21.954409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:21.954684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] PATH_INFO: `/v3/users/687ec6a81c6e4789a7341a3aae99d057` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:21.955915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687ec6a81c6e4789a7341a3aae99d057)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:21.957851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:22.071961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:22.074093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:22.090687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cbec1-6b0c-486b-9e5f-8210ddb1edbc service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:22.095673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:22.096391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:22.096604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:22.096882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] PATH_INFO: `/v3/projects/fe52fcb678a944d0a72847d116896d31` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:22.098279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe52fcb678a944d0a72847d116896d31)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:22.102646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:22.192466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687ec6a81c6e4789a7341a3aae99d057'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.193109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687ec6a81c6e4789a7341a3aae99d057'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.212121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687ec6a81c6e4789a7341a3aae99d057'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.220313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687ec6a81c6e4789a7341a3aae99d057'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.240070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe52fcb678a944d0a72847d116896d31', 'request_id': 'req-33f5ac9a-ca42-4db9-9323-869dea38dc7d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.247781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe52fcb678a944d0a72847d116896d31', 'request_id': 'req-33f5ac9a-ca42-4db9-9323-869dea38dc7d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.258267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe52fcb678a944d0a72847d116896d31', 'request_id': 'req-33f5ac9a-ca42-4db9-9323-869dea38dc7d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.304694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-69057805-002b-4230-8925-389eb9cc39b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687ec6a81c6e4789a7341a3aae99d057'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.311911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1072/2109] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:21 2022] DELETE /identity/v3/users/687ec6a81c6e4789a7341a3aae99d057 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:22.316570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:22.317458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:22.317458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:22.335953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:22.337198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:22.361666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] The token cache is being invalidate because project fe52fcb678a944d0a72847d116896d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:22.362163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.362799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.364346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1038/2110] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:22 2022] DELETE /identity/v3/projects/fe52fcb678a944d0a72847d116896d31 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:22.368316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:22.369951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:22.388382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:22.399502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1073/2111] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:22.409981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:22.411829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:22.444742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ac9a-ca42-4db9-9323-869dea38dc7d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:22.450163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:22.450331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:22.450819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:22.451099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:22.451372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] PATH_INFO: `/v3/users/26d134ead7c34546a8c27c1d45cc6885` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:22.452551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d134ead7c34546a8c27c1d45cc6885)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:22.454611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:22.474023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d1dd2-4001-4de7-84e1-dd6a8107773a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:22.477702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:22.478385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:22.478805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:22.479091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:22.489035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:22.490572 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:22.500903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1074/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:22.678631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d134ead7c34546a8c27c1d45cc6885'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.679294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d134ead7c34546a8c27c1d45cc6885'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.692084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d134ead7c34546a8c27c1d45cc6885'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.692950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d134ead7c34546a8c27c1d45cc6885'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.756940 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d134ead7c34546a8c27c1d45cc6885'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.790168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1039/2113] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:22 2022] DELETE /identity/v3/users/26d134ead7c34546a8c27c1d45cc6885 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:23.076480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:23.078105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.092387 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b87213-b512-4a4f-b097-bf0936a6298e service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:23.176265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:23.176988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.177270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.177552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] PATH_INFO: `/v3/projects/4a6ae4dd17ce42bcb7f1a687502f751a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.178954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6ae4dd17ce42bcb7f1a687502f751a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:23.182039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:23.318990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:23.327375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.340846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6ae4dd17ce42bcb7f1a687502f751a', 'request_id': 'req-86f23126-7ad4-4311-b8fc-4e9ff89f6014'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.345420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ec39-7a9f-440e-9389-d8e7c69ad8a0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:23.347596 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6ae4dd17ce42bcb7f1a687502f751a', 'request_id': 'req-86f23126-7ad4-4311-b8fc-4e9ff89f6014'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.354030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6ae4dd17ce42bcb7f1a687502f751a', 'request_id': 'req-86f23126-7ad4-4311-b8fc-4e9ff89f6014'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.410682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:23.411381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.411674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.411957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] PATH_INFO: `/v3/projects/6c525f1e719449ad8f7cd6ed9e200083` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.413136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c525f1e719449ad8f7cd6ed9e200083)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:23.415080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:23.453332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] The token cache is being invalidate because project 4a6ae4dd17ce42bcb7f1a687502f751a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:23.453681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.454366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.456147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1075/2114] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:23 2022] DELETE /identity/v3/projects/4a6ae4dd17ce42bcb7f1a687502f751a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:23.470561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:23.472046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.486005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23126-7ad4-4311-b8fc-4e9ff89f6014 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:23.490868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:23.491605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.491955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.492331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] PATH_INFO: `/v3/users/336446b836be417caeab9f94ad02e863` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.493662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336446b836be417caeab9f94ad02e863)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:23.496965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:23.530893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:23.540513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c525f1e719449ad8f7cd6ed9e200083', 'request_id': 'req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.547695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c525f1e719449ad8f7cd6ed9e200083', 'request_id': 'req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.554172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c525f1e719449ad8f7cd6ed9e200083', 'request_id': 'req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.658983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] The token cache is being invalidate because project 6c525f1e719449ad8f7cd6ed9e200083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:23.659281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.659922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-16ced1ee-4f61-4fbf-a6fd-fccef7e8fd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.661413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1040/2115] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:23 2022] DELETE /identity/v3/projects/6c525f1e719449ad8f7cd6ed9e200083 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:23.666726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6343-4ae5-40be-a7d5-e7ed564aec1e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.667546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6343-4ae5-40be-a7d5-e7ed564aec1e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.668019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6343-4ae5-40be-a7d5-e7ed564aec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.691429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7a5a6343-4ae5-40be-a7d5-e7ed564aec1e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:23.692669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7a5a6343-4ae5-40be-a7d5-e7ed564aec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.724543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336446b836be417caeab9f94ad02e863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.725229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336446b836be417caeab9f94ad02e863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.734751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:23.739406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336446b836be417caeab9f94ad02e863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.746699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336446b836be417caeab9f94ad02e863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.756970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1041/2116] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:23.766816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.767105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.767379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.788838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:23.790169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.795583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336446b836be417caeab9f94ad02e863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:23.799171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1042/2117] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:23.802092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1076/2118] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:23 2022] DELETE /identity/v3/users/336446b836be417caeab9f94ad02e863 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:23.807462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:23.814723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d145c2-255b-4851-a2d3-9a869850d92c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:23.879663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:23.880846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.881192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.882042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.883340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:23.883903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:23.885838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:23.898537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1043/2119] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:23.904515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:23.915170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:23.921022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d2cd2-33ca-47a4-9a3d-142f630da513 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:23.926176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:23.926838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:23.927313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:23.927548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:23.928222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:23.930203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.038157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1077/2120] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:23 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:24.045626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.056908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e391fe8-6b79-49f1-b90f-c89bcb794999 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.124806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:24.134131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.134829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.135097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.135495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.136243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.138809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.256651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1044/2121] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:24.258467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.269534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4fd12-d6c8-4a4e-a6a7-1c4b17f2bbed admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.274259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.274877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.275165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.275439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.276130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.277804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.289042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1078/2122] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:24.293903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.305812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941163-3fd4-425d-81e2-aef146080bf9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.311517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.312168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.312452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.315421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.315421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.315421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.317611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.319535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.329709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1045/2123] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:24.330776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.335469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e743b8-4e93-4dcf-83bd-33683fd30788 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.342006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.342649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1698e-98f5-438b-be1f-82f979a03b94 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.342738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.343022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.343227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] PATH_INFO: `/v3/projects/7f68b94444d64209a298a0848a85c030` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.344427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f68b94444d64209a298a0848a85c030)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.346616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.348528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.349226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.349558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.349877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] PATH_INFO: `/v3/projects/15109efa8ce8445580ba507a71ccfd07/users/0c4299fa43254c03b86095de9d3bcad0/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.369590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15109efa8ce8445580ba507a71ccfd07, user_id=0c4299fa43254c03b86095de9d3bcad0, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.373695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897cdc5-c681-4f13-83a4-4f5c9ddefe66 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.431085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1046/2124] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:24 2022] PUT /identity/v3/projects/15109efa8ce8445580ba507a71ccfd07/users/0c4299fa43254c03b86095de9d3bcad0/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:24.441659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.441989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.442271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.442878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f68b94444d64209a298a0848a85c030', 'request_id': 'req-0e257dd2-2c94-4a53-85b7-fe036c95eb69'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.449940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f68b94444d64209a298a0848a85c030', 'request_id': 'req-0e257dd2-2c94-4a53-85b7-fe036c95eb69'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.455721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f68b94444d64209a298a0848a85c030', 'request_id': 'req-0e257dd2-2c94-4a53-85b7-fe036c95eb69'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.471549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] MFA Rules not processed for user `0c4299fa43254c03b86095de9d3bcad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:24.472769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.516063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] The token cache is being invalidate because project 7f68b94444d64209a298a0848a85c030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:24.516420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.517073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-0e257dd2-2c94-4a53-85b7-fe036c95eb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.518906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1079/2125] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:24 2022] DELETE /identity/v3/projects/7f68b94444d64209a298a0848a85c030 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:24.524844 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908989d-186e-4f73-8243-742c72b17e19 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.527660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908989d-186e-4f73-8243-742c72b17e19 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.527660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908989d-186e-4f73-8243-742c72b17e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.550690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1047/2126] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:24.550883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8908989d-186e-4f73-8243-742c72b17e19 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:24.550883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8908989d-186e-4f73-8243-742c72b17e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.551898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.555029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.620791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1080/2127] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:24.631214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.631504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.631789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.638253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e7fe-8166-4d28-b209-9141411f9558 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.643593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.644406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.644694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.645108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.645649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.647605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.658886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:24.660245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.669217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1081/2128] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:24.673542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.682812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f903f-8d55-435c-9517-bf67dc38570d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.687670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.688259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.688544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.688823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.689527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:24.689877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.691524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.708778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1082/2129] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:24.713322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.727830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c254d1-5d61-482b-bcd4-c220c5cc4f1b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.733738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.734580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1048/2130] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:24.734723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.734723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.735090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.735946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.738027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.738486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.744210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:24.773518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:24.812053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb219b4-fe27-41f1-b94f-41614a404d68 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.816785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.817418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.817724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.818022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.818715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.820636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.865075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1083/2131] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:24.869745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.921178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1049/2132] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:24.925325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.935268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d992-6e80-47ad-b10c-859a0224d2fb admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.935679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025bd7f-0976-4ca4-9d3a-b078f335b57c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.939892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.940217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.940584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.940867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.940978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.941152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.941270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.941503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.941852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.942285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.943800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.943942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.955090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1050/2133] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:24.965841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.976274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178afbd2-3c26-41f9-92fe-1af86cda6167 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.981634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.982462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.982783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.983066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] PATH_INFO: `/v3/projects/aada379c1eeb469fa0aa45e265277fc4/users/6edf56a55a8e4fbe9e147e96f7475635/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.998784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aada379c1eeb469fa0aa45e265277fc4, user_id=6edf56a55a8e4fbe9e147e96f7475635, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.001458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.053086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1084/2134] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:25.057587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.068925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6bf5e-a2ad-464b-a34f-c6a20aadf2c8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.082838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1051/2135] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:24 2022] PUT /identity/v3/projects/aada379c1eeb469fa0aa45e265277fc4/users/6edf56a55a8e4fbe9e147e96f7475635/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:25.083101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.083733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.092657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.092657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.092657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.092915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.093027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.106687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1085/2136] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:25.110805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.121792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ceb3a-2619-41a8-b607-0452f362c9d9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.180543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086c650-486f-4294-b15a-6f9531e3ad69 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.185962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.186521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.186808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.187127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.187827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.189482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.203586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1052/2137] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:25.205007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.205315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.205722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.206070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.206450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.207168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.208973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.216660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55f788-7600-4907-956d-fa52889dba68 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.221906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.222613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.223071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.223225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] PATH_INFO: `/v3/projects/aada379c1eeb469fa0aa45e265277fc4/users/6edf56a55a8e4fbe9e147e96f7475635/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.229507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aada379c1eeb469fa0aa45e265277fc4, user_id=6edf56a55a8e4fbe9e147e96f7475635, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.232465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1086/2138] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:25.232582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f02729-24e8-4feb-93a3-e3feb6f1778b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.236544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.248548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fdc3-9baa-4402-89ca-f854eeea93cb admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.253854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1053/2139] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:25 2022] PUT /identity/v3/projects/aada379c1eeb469fa0aa45e265277fc4/users/6edf56a55a8e4fbe9e147e96f7475635/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:25.267155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.267361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.267625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.302742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] MFA Rules not processed for user `6edf56a55a8e4fbe9e147e96f7475635`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:25.304130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.314402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.315092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.315378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.315659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] PATH_INFO: `/v3/projects/1348997dbbb64a359f15fda93aa24a74/users/76750323f4ff4ff7841bdce9c008c4df/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.318046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:25.342597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1348997dbbb64a359f15fda93aa24a74, user_id=76750323f4ff4ff7841bdce9c008c4df, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.345502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd6af-b5b8-4592-adad-180f978873a9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.362838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:25.384581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1054/2140] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:25.396746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.398172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.456633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7191-f1f6-4261-9245-455798fc8103 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.457267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1087/2141] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:25 2022] PUT /identity/v3/projects/1348997dbbb64a359f15fda93aa24a74/users/76750323f4ff4ff7841bdce9c008c4df/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:25.474096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.474670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.475020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.509214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] MFA Rules not processed for user `76750323f4ff4ff7841bdce9c008c4df`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:25.510475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.516809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.517439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.517800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.518037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.585021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.586838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.588887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1088/2142] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:25.598674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1055/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:25.814621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.816121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.913381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b568101-9cb7-4079-9234-c003be6ddc76 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.917942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.918818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.919304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.919667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] PATH_INFO: `/v3/users/a05e781b607f44abb5660b823071e913` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.920937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05e781b607f44abb5660b823071e913)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.923000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.161120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05e781b607f44abb5660b823071e913'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.161820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05e781b607f44abb5660b823071e913'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.174389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05e781b607f44abb5660b823071e913'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.181967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05e781b607f44abb5660b823071e913'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.184476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:26.260187 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-00c95574-e2dc-41d9-994f-772f7f05a62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05e781b607f44abb5660b823071e913'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.270400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1089/2144] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:25 2022] DELETE /identity/v3/users/a05e781b607f44abb5660b823071e913 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:26.271138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.274324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.274607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.274907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.288401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94e52-eae4-4ce4-be17-3816dae0036b service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.295595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:26.296935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.341431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:26.354875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.356188 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.356539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.356814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] PATH_INFO: `/v3/users/0c4299fa43254c03b86095de9d3bcad0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.358016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4299fa43254c03b86095de9d3bcad0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.360039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1090/2145] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:26.363106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.369876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.372191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.448145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e1434-efc5-4648-984e-5fa248edf3de None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.453131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.454213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.454213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.454415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.464538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.466278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e8598-eebc-439e-a2bf-dbd1213a2190 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.480973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1091/2146] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:26.573295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4299fa43254c03b86095de9d3bcad0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.574632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4299fa43254c03b86095de9d3bcad0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.590810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4299fa43254c03b86095de9d3bcad0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.591499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4299fa43254c03b86095de9d3bcad0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.700849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4299fa43254c03b86095de9d3bcad0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:26.721994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1056/2147] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:26 2022] DELETE /identity/v3/users/0c4299fa43254c03b86095de9d3bcad0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:26.727299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.727638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.727982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.757128 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:26.763819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.859506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1092/2148] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:26.883913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.885504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.952927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d121b-2bd4-463e-badb-fc9c91ae8045 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.956664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.957414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.957618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.957909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.969325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.970999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2229-bccf-4af3-9601-ea7c0e1b34b7 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.981714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1057/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:27.004917 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.006441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.026680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee0b2b-2fe8-4f62-936d-54cc7de67804 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.036318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.037218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.037789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.037901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] PATH_INFO: `/v3/projects/82274f1f4a344e3c87bc20035db644cc` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.042638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82274f1f4a344e3c87bc20035db644cc)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.042638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.138076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:27.150933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82274f1f4a344e3c87bc20035db644cc', 'request_id': 'req-f762abc6-12d2-4049-9ac4-9aae0edadae3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.159141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82274f1f4a344e3c87bc20035db644cc', 'request_id': 'req-f762abc6-12d2-4049-9ac4-9aae0edadae3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.165953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82274f1f4a344e3c87bc20035db644cc', 'request_id': 'req-f762abc6-12d2-4049-9ac4-9aae0edadae3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.252171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] The token cache is being invalidate because project 82274f1f4a344e3c87bc20035db644cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:27.252550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.253277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f762abc6-12d2-4049-9ac4-9aae0edadae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.255276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1093/2150] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:27 2022] DELETE /identity/v3/projects/82274f1f4a344e3c87bc20035db644cc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:27.260034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.260692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.261137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.289847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:27.291852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.369170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1058/2151] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:27.381594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.381594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.381594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.401332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:27.403457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.412380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1094/2152] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:27.416824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.427656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78b26-668e-4c65-9b21-c0fab85111ff None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.432114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.432720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.433001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.433325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.434578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:27.434773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.439123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.443563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.445788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.445942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:27.450049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1059/2153] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:27.454127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.461916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfb58-9aef-4bef-81ff-506a97d00a26 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.465162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9184-ca13-42e7-b18a-14a9fbe56229 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.470930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.471042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.471426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.471559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.471704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.471800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.471987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] PATH_INFO: `/v3/projects/15109efa8ce8445580ba507a71ccfd07` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.472099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.472694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.473352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15109efa8ce8445580ba507a71ccfd07)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.474715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.475610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.569388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1060/2154] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:27.578011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.650284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15109efa8ce8445580ba507a71ccfd07', 'request_id': 'req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.657919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15109efa8ce8445580ba507a71ccfd07', 'request_id': 'req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.663725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e597-60c2-4dce-85f7-2f35f61c44d7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.666121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15109efa8ce8445580ba507a71ccfd07', 'request_id': 'req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.728463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.729032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.729319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.729589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.730320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.732399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.750992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] The token cache is being invalidate because project 15109efa8ce8445580ba507a71ccfd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:27.751406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.752436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.754207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1095/2155] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:27 2022] DELETE /identity/v3/projects/15109efa8ce8445580ba507a71ccfd07 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:27.758577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.760274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.774318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d69c-303e-44e8-a8a4-ea7bb04f4863 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.779119 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.779767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.780055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.780334 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] PATH_INFO: `/v3/users/6edf56a55a8e4fbe9e147e96f7475635` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.781505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edf56a55a8e4fbe9e147e96f7475635)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.783503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.842249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1061/2156] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:27.846247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.847946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.860496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706ed9-6cff-473b-bfcd-b25beb902d15 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.865393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.866044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.866354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.866631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.867328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.869305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.883205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1062/2157] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:27.887415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.899474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae56f6-a2fb-4321-af56-21768cb73a86 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.904468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.905077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.905358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.905636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.906356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.908016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.920031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1063/2158] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:27.924283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.935224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad4bcd-d21e-4b32-a904-62c90d200cd7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.940371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.941278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.941654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.942003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] PATH_INFO: `/v3/projects/f6b2f2519513419195561174b5657008/users/7fe9b8d7388f4bc5b282d6bb53517b22/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.959240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b2f2519513419195561174b5657008, user_id=7fe9b8d7388f4bc5b282d6bb53517b22, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.962091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811fdce-c0dd-4e02-b9dc-a5ec221d0bb3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.010156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edf56a55a8e4fbe9e147e96f7475635'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.010723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edf56a55a8e4fbe9e147e96f7475635'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.023729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edf56a55a8e4fbe9e147e96f7475635'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.031175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edf56a55a8e4fbe9e147e96f7475635'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.053140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1064/2159] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:27 2022] PUT /identity/v3/projects/f6b2f2519513419195561174b5657008/users/7fe9b8d7388f4bc5b282d6bb53517b22/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:28.065635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.065957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.066240 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.093507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] MFA Rules not processed for user `7fe9b8d7388f4bc5b282d6bb53517b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:28.094749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.114151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edf56a55a8e4fbe9e147e96f7475635'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.122402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1096/2160] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:27 2022] DELETE /identity/v3/users/6edf56a55a8e4fbe9e147e96f7475635 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:28.165284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1065/2161] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:28.171323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.173782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.184582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=75,keystone:DELETE=22,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.241718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b24e6-25af-4414-8e69-5abc85b47138 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.247620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.248327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.248661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.248961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.249661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.251768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.337702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.345787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1097/2162] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:28.349596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.426158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f85f1-5c88-4531-aa78-7cd09622e001 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.488394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.489047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.489359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.489662 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.490444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.492355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.594487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.595095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1066/2163] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:28.596072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.597509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.620353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228164b-144c-4d03-81e4-2f58ddcb55b0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.626204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.626536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef272f8-1362-4d0b-bf39-4145038a5217 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.626835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.627204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.627595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.628309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.630503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.635550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.636206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.637075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.637356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] PATH_INFO: `/v3/projects/aada379c1eeb469fa0aa45e265277fc4` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.643576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aada379c1eeb469fa0aa45e265277fc4)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.643576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.643768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1067/2164] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:28.646549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.657187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491715b-44cb-4105-89cc-cd1ae8b842ca admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.661911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.663064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.663064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.665174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] PATH_INFO: `/v3/projects/822714274bc44b83866fe0f77fa8c45e/users/12795ed598644ad886083321723a38b7/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.681989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822714274bc44b83866fe0f77fa8c45e, user_id=12795ed598644ad886083321723a38b7, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.685666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.769113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1068/2165] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:28 2022] PUT /identity/v3/projects/822714274bc44b83866fe0f77fa8c45e/users/12795ed598644ad886083321723a38b7/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:28.776059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.794162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aada379c1eeb469fa0aa45e265277fc4', 'request_id': 'req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.802327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aada379c1eeb469fa0aa45e265277fc4', 'request_id': 'req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.820794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aada379c1eeb469fa0aa45e265277fc4', 'request_id': 'req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.831967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.891577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c164a0-adcc-4171-8cd9-27f42cabbaa9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.921939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] The token cache is being invalidate because project aada379c1eeb469fa0aa45e265277fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:28.922297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.923206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-bfbbe613-07bd-483f-978c-9dbe5d56cd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:28.924939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1098/2166] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:28 2022] DELETE /identity/v3/projects/aada379c1eeb469fa0aa45e265277fc4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:28.929832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.930154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.930431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.951787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.952453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.952743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.953024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.953677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:28.953839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.954998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.955371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ea391-d49e-4c37-9ab7-8eef10f61e69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.963413 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1099/2167] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:28.969794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1069/2168] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:28.972186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.973646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.974945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.975245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.975532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.987536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374b18b-0d7b-4d4b-8443-892170c4ca64 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.993466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.994437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.994721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.994995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] PATH_INFO: `/v3/projects/822714274bc44b83866fe0f77fa8c45e/users/12795ed598644ad886083321723a38b7/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.997140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:28.997263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=822714274bc44b83866fe0f77fa8c45e, user_id=12795ed598644ad886083321723a38b7, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.998391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.000574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48bb0-3a06-4ba2-a1c9-47ab03406f9c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.009795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1070/2169] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:29.013868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.020570 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1100/2170] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:28 2022] PUT /identity/v3/projects/822714274bc44b83866fe0f77fa8c45e/users/12795ed598644ad886083321723a38b7/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:29.024341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cfa63-5b9e-478b-a478-617e6b01050e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.033203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.033495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.033842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.063873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] MFA Rules not processed for user `12795ed598644ad886083321723a38b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:29.065238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.092854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.092854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.092854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.092854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.093335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:29.093479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.095295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.111299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1071/2171] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:29.111986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.113353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.123938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc824-21d2-4c54-8ba4-6595ef16fa3c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.135142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.135784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.136049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.136356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.137021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.139050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.139158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1101/2172] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:29.152809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.155290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.211140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9618eae-cfd7-4c36-85a2-c4d67bc3f04a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.215420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.216139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.216427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.216704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.226152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.227590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.235682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1072/2173] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:29.236770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.238335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1102/2174] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:29.269931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.306579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a4d6-fe0e-4a69-9567-2f88ac45b000 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.307435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.308063 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.308694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.308694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.309364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.311337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.549973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1073/2175] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/users => generated 292 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:29.554164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.568781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770b18e-a89e-4050-b9a2-79536be7151a service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.572433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.573048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.573332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.573612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.574487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.576313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.576465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.586872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1103/2176] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:29.590731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.600451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecbebb-6317-4442-80d8-002b5b8d2c78 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.605596 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.606230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.606520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.606801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.607490 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.609083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.619441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1104/2177] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:29.626243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.637487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d32b4-7d16-4e7a-9ab5-b922245958b0 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.638218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805837-97af-410b-b191-a175f1d72e08 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.643109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.644305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.644305 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.644882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.646426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.647232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.647905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.648245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.648473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] PATH_INFO: `/v3/projects/f9d279d36a1244ad946ad1ce92530c8c/users/8c802e58786c40fa8dcbe0f2935fd8e9/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.668615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d279d36a1244ad946ad1ce92530c8c, user_id=8c802e58786c40fa8dcbe0f2935fd8e9, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.671766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.707971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.709428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ede075-5438-4325-a70b-194e8781df24 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.718860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1074/2178] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:29.739832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1105/2179] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:29 2022] PUT /identity/v3/projects/f9d279d36a1244ad946ad1ce92530c8c/users/8c802e58786c40fa8dcbe0f2935fd8e9/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:29.747532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.747818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.748205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.780395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] MFA Rules not processed for user `8c802e58786c40fa8dcbe0f2935fd8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:29.781666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.847140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1075/2180] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:29.851690 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.918766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929d19-e666-473f-b95f-df2f64abc7af admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.924075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.924779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.925093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.925395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.926290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.928365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.025535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1106/2181] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:30.030296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.036096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:30.043655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96296fc-1591-46f5-8c2d-4b83ce33ed3a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.108209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.108849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.109134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.109415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.110136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.112193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.210529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1076/2182] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:30 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:30.211734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.222892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aafc-f441-49ae-9914-424b869557f9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.227873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.228499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.228776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.229054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.229779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.233320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.242312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1107/2183] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:30.246849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.257059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1f54-d7c6-499e-94e9-4d3d2468d992 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.262394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.263132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.263391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.263669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] PATH_INFO: `/v3/projects/b1933ad9bebe46428381d5a6f559582a/users/3abc3ef7bd724cd1ba47f9611eb9c7b6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.281706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1933ad9bebe46428381d5a6f559582a, user_id=3abc3ef7bd724cd1ba47f9611eb9c7b6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.283764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.367576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1077/2184] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:30 2022] PUT /identity/v3/projects/b1933ad9bebe46428381d5a6f559582a/users/3abc3ef7bd724cd1ba47f9611eb9c7b6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:30.372141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.382314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5694-3680-4fb2-93fc-2ff12149f02a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.391159 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:30.444620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.445303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.445584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.445906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.446605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.448468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ed852-562a-4b16-abe4-48c94fa161ab admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.459147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1108/2185] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:30.463434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.474589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb945a90-b170-49fc-880c-2085c8636e56 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.479249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.479978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.480376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.480656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] PATH_INFO: `/v3/projects/b1933ad9bebe46428381d5a6f559582a/users/3abc3ef7bd724cd1ba47f9611eb9c7b6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.482675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1933ad9bebe46428381d5a6f559582a, user_id=3abc3ef7bd724cd1ba47f9611eb9c7b6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.485354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.497072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1078/2186] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:30 2022] PUT /identity/v3/projects/b1933ad9bebe46428381d5a6f559582a/users/3abc3ef7bd724cd1ba47f9611eb9c7b6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:30.508894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.509188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.509472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.542270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] MFA Rules not processed for user `3abc3ef7bd724cd1ba47f9611eb9c7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:30.543659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.614012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1109/2187] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:30.628342 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.634424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.689978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeee33-bebe-482a-b679-2d7b03e463cf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.693846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.694478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.694760 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.695037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.705256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.706720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.716676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1079/2188] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:30.830002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.838078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9517-652b-4559-9380-af6c1088aed3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.841595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.842234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.842543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.842775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.901150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.902658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e679f4b-864f-476f-abf6-416e8c675179 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.913099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1110/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:31.405767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:31.468678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.472815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858f87-787a-4bd9-b2f5-2eb20d4954bc service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.477484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.478300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.478622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.478814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] PATH_INFO: `/v3/users/8c802e58786c40fa8dcbe0f2935fd8e9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.480669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c802e58786c40fa8dcbe0f2935fd8e9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.482841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:31.752623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c802e58786c40fa8dcbe0f2935fd8e9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:31.753275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c802e58786c40fa8dcbe0f2935fd8e9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:31.775397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c802e58786c40fa8dcbe0f2935fd8e9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:31.779942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c802e58786c40fa8dcbe0f2935fd8e9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:31.881351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c802e58786c40fa8dcbe0f2935fd8e9'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:31.897944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1080/2190] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:31 2022] DELETE /identity/v3/users/8c802e58786c40fa8dcbe0f2935fd8e9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:31.903202 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.903658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.903779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.924186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:31.925606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.959383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.998416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1111/2191] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:32.008180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.009670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:32.087215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34713160-3466-4830-8e0b-05ee7fe08bef admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.091906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.094963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.094963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.094963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.103123 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.104575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.114317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1081/2192] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:32.666037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.666037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:32.672957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d454ac4-c4ba-42d7-9e98-73963c8fa3ec None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.678068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.678713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.679097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.679438 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] PATH_INFO: `/v3/projects/f9d279d36a1244ad946ad1ce92530c8c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.680901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d279d36a1244ad946ad1ce92530c8c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.682885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.800377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d279d36a1244ad946ad1ce92530c8c', 'request_id': 'req-af7647e8-7f9a-45ab-983f-4bbfbc925a00'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:32.807702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d279d36a1244ad946ad1ce92530c8c', 'request_id': 'req-af7647e8-7f9a-45ab-983f-4bbfbc925a00'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:32.814994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d279d36a1244ad946ad1ce92530c8c', 'request_id': 'req-af7647e8-7f9a-45ab-983f-4bbfbc925a00'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:32.902926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] The token cache is being invalidate because project f9d279d36a1244ad946ad1ce92530c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:32.903208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:32.903822 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:32.905333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1112/2193] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:32 2022] DELETE /identity/v3/projects/f9d279d36a1244ad946ad1ce92530c8c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:32.909451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.920657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14964-961a-4498-a5af-eb086c99c6c5 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.984784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.985346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.985627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.985933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] PATH_INFO: `/v3/users/3abc3ef7bd724cd1ba47f9611eb9c7b6` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.987095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abc3ef7bd724cd1ba47f9611eb9c7b6)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.989007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:33.012145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:33.229710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abc3ef7bd724cd1ba47f9611eb9c7b6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.231051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abc3ef7bd724cd1ba47f9611eb9c7b6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.242524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abc3ef7bd724cd1ba47f9611eb9c7b6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.243108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abc3ef7bd724cd1ba47f9611eb9c7b6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.313868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abc3ef7bd724cd1ba47f9611eb9c7b6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.326881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1082/2194] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:32 2022] DELETE /identity/v3/users/3abc3ef7bd724cd1ba47f9611eb9c7b6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:33.581661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:33.583253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.664417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7647e8-7f9a-45ab-983f-4bbfbc925a00 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:33.745547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:33.747373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.748131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.748131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.750833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.790855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:33.830800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:33.832425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007b5e-c201-47f3-aab5-fdcaefbace4b service glance] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:33.852164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1113/2195] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:33.935328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:33.937296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.019313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de710-454a-4bf9-8ef1-8027cfdd220d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.023950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.024604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.024890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.025172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] PATH_INFO: `/v3/projects/b1933ad9bebe46428381d5a6f559582a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.026356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1933ad9bebe46428381d5a6f559582a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.028801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.160899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1933ad9bebe46428381d5a6f559582a', 'request_id': 'req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:34.173514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1933ad9bebe46428381d5a6f559582a', 'request_id': 'req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:34.176373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1933ad9bebe46428381d5a6f559582a', 'request_id': 'req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:34.272879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] The token cache is being invalidate because project b1933ad9bebe46428381d5a6f559582a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:34.272879 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:34.273389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c272cf09-8b62-4e5f-a09b-9c4f9c37a54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:34.281146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1083/2196] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:33 2022] DELETE /identity/v3/projects/b1933ad9bebe46428381d5a6f559582a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:34.286135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.286614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.286695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.306138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.307694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.368134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1114/2197] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:34.376870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.377144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.377457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.398279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.399496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.408087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1084/2198] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:34.412244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.422715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2dbe5-9e2f-4a5b-80de-f706a3c6b563 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.427345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.428189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.428776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.429058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.429784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:34.430115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.431729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.445516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1115/2199] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:34.450742 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.460064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f913c9-e66e-4b62-981d-7694e4b5fd47 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.465275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.465993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.466322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.466598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.467257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.469132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.568389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:34.575714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1085/2200] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:34.579949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.591198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72101f24-5ac0-45de-b615-e532b2fe248e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.654878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.655546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.655829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.656107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.656775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.658753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.748848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1116/2201] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:34.753169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.764863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2da8-0e8c-4438-989a-b788aa4d7b21 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.769908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.770752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.771216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.771715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.772422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.774044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.795946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1086/2202] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:34.797098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.807864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db786-2468-4c5c-83e0-3d4195d27343 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.813792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.814552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.815091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.815317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.815915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.817560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a703f-9650-4573-a810-ffb482366242 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.832447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1117/2203] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:34.834015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.846521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693e483-7cd9-47e4-a76d-4e17a31a0d00 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.851266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.851941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.852229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.852509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] PATH_INFO: `/v3/projects/714cc98080ae4baaa11b8b946c67ba2c/users/0097e07390144f3a804eb5057c6b75e5/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.878218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714cc98080ae4baaa11b8b946c67ba2c, user_id=0097e07390144f3a804eb5057c6b75e5, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.878218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.958298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1087/2204] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:34 2022] PUT /identity/v3/projects/714cc98080ae4baaa11b8b946c67ba2c/users/0097e07390144f3a804eb5057c6b75e5/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:34.963074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c25aa-f517-4add-908e-ee652676bd7d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.963758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c25aa-f517-4add-908e-ee652676bd7d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.963758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c25aa-f517-4add-908e-ee652676bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.992459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d22c25aa-f517-4add-908e-ee652676bd7d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.994031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d22c25aa-f517-4add-908e-ee652676bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:35.025099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:35.065464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1118/2205] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:35.075595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:35.077346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:35.134769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40fd7-ea1f-4abd-9b65-2cb93e96c4f0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:35.141064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:35.141687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:35.142001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:35.142275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:35.151814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:35.153795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:35.163196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1088/2206] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:36.452127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15f89-9314-4737-b603-485ebebe1925 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:36.452674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15f89-9314-4737-b603-485ebebe1925 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:36.452769 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15f89-9314-4737-b603-485ebebe1925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:36.483734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-70b15f89-9314-4737-b603-485ebebe1925 None None] MFA Rules not processed for user `0097e07390144f3a804eb5057c6b75e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:36.484971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-70b15f89-9314-4737-b603-485ebebe1925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:36.561664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1119/2207] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:36.573254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:36.576937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:36.639717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a297e0-849e-4d8b-9f06-bcc9f6993131 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:36.643409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:36.644027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:36.644310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:36.644584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:36.654006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:36.655565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:36.664663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1089/2208] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:38.477575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aa171-696f-4d81-95e9-bbeb79029b69 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.478191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aa171-696f-4d81-95e9-bbeb79029b69 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.478313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86aa171-696f-4d81-95e9-bbeb79029b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.501518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b86aa171-696f-4d81-95e9-bbeb79029b69 None None] MFA Rules not processed for user `0097e07390144f3a804eb5057c6b75e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:38.502885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b86aa171-696f-4d81-95e9-bbeb79029b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.509743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1120/2209] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:42.874960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.876419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:42.890931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bd74d-e7e2-458f-996f-490fb7c5f6da service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.896027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.896688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.900866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.900866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] PATH_INFO: `/v3/users/7fe9b8d7388f4bc5b282d6bb53517b22` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.900866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe9b8d7388f4bc5b282d6bb53517b22)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.900866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:43.071761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe9b8d7388f4bc5b282d6bb53517b22'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.072518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe9b8d7388f4bc5b282d6bb53517b22'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.086310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe9b8d7388f4bc5b282d6bb53517b22'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.087084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe9b8d7388f4bc5b282d6bb53517b22'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.088842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:43.161156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe9b8d7388f4bc5b282d6bb53517b22'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.174035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1090/2210] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:42 2022] DELETE /identity/v3/users/7fe9b8d7388f4bc5b282d6bb53517b22 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:43.179174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.179676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.179840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.201529 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:43.202685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.279538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1121/2211] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:43.291824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:43.294158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.357157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1251ae-517f-4700-86c6-7560129e27cc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:43.361294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:43.361969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.362246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.362516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.386485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:43.388836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:43.399909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1091/2212] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:43.862784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:43.864269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.878967 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682995-cece-4163-9b8c-ecbe3dd844a5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:43.886560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:43.887326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.887688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.888129 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] PATH_INFO: `/v3/projects/f6b2f2519513419195561174b5657008` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.889370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b2f2519513419195561174b5657008)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:43.891327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.032138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b2f2519513419195561174b5657008', 'request_id': 'req-411072a4-d7a5-4f07-a96b-d689ff411c36'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.033285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:44.039170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b2f2519513419195561174b5657008', 'request_id': 'req-411072a4-d7a5-4f07-a96b-d689ff411c36'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.045678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b2f2519513419195561174b5657008', 'request_id': 'req-411072a4-d7a5-4f07-a96b-d689ff411c36'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.149554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] The token cache is being invalidate because project f6b2f2519513419195561174b5657008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:44.151198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.152694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.154315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1122/2213] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:43 2022] DELETE /identity/v3/projects/f6b2f2519513419195561174b5657008 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:44.158733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:44.169181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d566-8535-4c52-a42c-b4df298eceba service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:44.228954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:44.229624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.229945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.230908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] PATH_INFO: `/v3/users/12795ed598644ad886083321723a38b7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.232165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12795ed598644ad886083321723a38b7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.234237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.457084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12795ed598644ad886083321723a38b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.458086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12795ed598644ad886083321723a38b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.475173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12795ed598644ad886083321723a38b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.475173 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12795ed598644ad886083321723a38b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.556155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8f8a2df-089c-4b69-b0de-83a3cc4073c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12795ed598644ad886083321723a38b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:44.575504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1092/2214] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:44 2022] DELETE /identity/v3/users/12795ed598644ad886083321723a38b7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:45.037133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.040434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.053186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411072a4-d7a5-4f07-a96b-d689ff411c36 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.120389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.121252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.121598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.121927 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] PATH_INFO: `/v3/projects/822714274bc44b83866fe0f77fa8c45e` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.123340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822714274bc44b83866fe0f77fa8c45e)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.125700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.268565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822714274bc44b83866fe0f77fa8c45e', 'request_id': 'req-03ede330-dd16-45d8-8384-eec36a09cae1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.276002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822714274bc44b83866fe0f77fa8c45e', 'request_id': 'req-03ede330-dd16-45d8-8384-eec36a09cae1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.283139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822714274bc44b83866fe0f77fa8c45e', 'request_id': 'req-03ede330-dd16-45d8-8384-eec36a09cae1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.363058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] The token cache is being invalidate because project 822714274bc44b83866fe0f77fa8c45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:45.363358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.364080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-03ede330-dd16-45d8-8384-eec36a09cae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.367510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1123/2215] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:45 2022] DELETE /identity/v3/projects/822714274bc44b83866fe0f77fa8c45e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:45.378734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.379259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.379367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.403313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:45.408345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:45.410317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.474996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1093/2216] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:45.487898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.488415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.488955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.517890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:45.519453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.529790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1124/2217] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:45.534468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.557914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2465c5-119d-487a-ad1d-8ef0915d9208 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.574340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.575341 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.575965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.576412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.577291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:45.579487 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.581320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.600084 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1094/2218] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:45.603701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.615424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdfe6a-f3dc-4d0f-a9a9-9f52c73139c2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.621920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.622746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.623029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.623303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.623985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.626095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.733847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1125/2219] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:45 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:45.738328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.749062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2612-3ae2-44a8-a4a8-b20fcadc087f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.808170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.808945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.809228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.809508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.810268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.812198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.898499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1095/2220] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:45 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:45.903232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.914058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259948a2-5df8-4a1b-8b23-e46ae25c6622 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.918991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.919596 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.919877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.920150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.920866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.922495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.932639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1126/2221] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:45.936528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.946548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9606-8a26-40b1-80d6-ea5dbb2aa0e0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.952088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.952690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.952972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.953245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.953971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.955540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca898b0d-68ec-4b6e-9bbb-76a8f175e641 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.966482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1096/2222] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:45.970757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.986835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3cbb7-5581-43f6-9d83-15eca4cb6f35 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.992944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.994013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.995889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.995889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] PATH_INFO: `/v3/projects/b92fa9f0512f40d59800413063f99149/users/955fb550e570466aa7f2c2001a610afd/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.011305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92fa9f0512f40d59800413063f99149, user_id=955fb550e570466aa7f2c2001a610afd, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.014672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.085627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1127/2223] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:45 2022] PUT /identity/v3/projects/b92fa9f0512f40d59800413063f99149/users/955fb550e570466aa7f2c2001a610afd/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:46.096451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.096914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.097266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.130049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] MFA Rules not processed for user `955fb550e570466aa7f2c2001a610afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:46.131271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.196692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:46.201215 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1097/2224] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:46.205856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.211465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:46.270937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc3b65-638b-4a35-99bc-8542b90789ff admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.275779 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.276330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.276613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.276893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.278130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.280060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.385893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1128/2225] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:46 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:46.387028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.398864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696c39e-5fda-4e8a-9850-ee59dd35085b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.493451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.494436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.494720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.494991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.495670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.498221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.588783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1098/2226] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:46 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:46.593696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.607889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46cb0a-713d-4af9-b379-29c7253cf2ed admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.615789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.616540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.617070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.617261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.618164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.620682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.637041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1129/2227] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:46.638482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.656738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0d52-a587-4f70-90b0-ad969d3419f0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.662109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.663007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.663296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.663580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] PATH_INFO: `/v3/projects/a64e08bd79a44c75bfab88a5ed14b009/users/8ccfb44d634241f89a014fc2da18b769/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.679108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e08bd79a44c75bfab88a5ed14b009, user_id=8ccfb44d634241f89a014fc2da18b769, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.684635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.781809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1099/2228] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:46 2022] PUT /identity/v3/projects/a64e08bd79a44c75bfab88a5ed14b009/users/8ccfb44d634241f89a014fc2da18b769/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:46.785527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.799415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7fdf-644d-47af-9793-712aa8899fd3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.867266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.868248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.868961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.869245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.870051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.872402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d4260-f652-4e50-84ef-1043dc2ed8c6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.884517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1130/2229] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:46.888611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.901029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89941b1-441f-4aa6-a3af-2d4386c1c057 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.906657 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.907409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.907700 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.907980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] PATH_INFO: `/v3/projects/a64e08bd79a44c75bfab88a5ed14b009/users/8ccfb44d634241f89a014fc2da18b769/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.923883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e08bd79a44c75bfab88a5ed14b009, user_id=8ccfb44d634241f89a014fc2da18b769, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.923883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.933246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1100/2230] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:46 2022] PUT /identity/v3/projects/a64e08bd79a44c75bfab88a5ed14b009/users/8ccfb44d634241f89a014fc2da18b769/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:46.944724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.945016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.945294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.980209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] MFA Rules not processed for user `8ccfb44d634241f89a014fc2da18b769`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:46.980209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:47.044647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:47.048093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1131/2231] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:47.059267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.061057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:47.135590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32abf60-2c21-42ed-8b39-25defca2e20e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.140147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.140876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.141231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.141579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.152986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.154547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.165665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1101/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:47.281475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.291406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7211f7-3bec-4b13-a8ea-57b25f245cdc None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.295728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.296346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.296635 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.296971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.353466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.354955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718ddc8-27b5-477d-9f8a-817ddc03bfe7 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.364738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1132/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:50.650515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:50.720385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:50.726812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc985-c9b2-47d8-9a47-bb4f87e14edc service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.734440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.735104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.735387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.735728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] PATH_INFO: `/v3/users/955fb550e570466aa7f2c2001a610afd` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.737050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=955fb550e570466aa7f2c2001a610afd)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:50.739026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:50.960120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955fb550e570466aa7f2c2001a610afd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.960771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955fb550e570466aa7f2c2001a610afd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.972642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955fb550e570466aa7f2c2001a610afd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.973314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955fb550e570466aa7f2c2001a610afd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.062118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955fb550e570466aa7f2c2001a610afd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.074934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1102/2234] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:50 2022] DELETE /identity/v3/users/955fb550e570466aa7f2c2001a610afd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:51.079542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.080002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.080093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.099394 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:51.100605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.165555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1133/2235] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:51.180016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:51.181527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.241177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6841c7-2400-4a48-afdc-66f85a667d0d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:51.245163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:51.246439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.246728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.247008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.256730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.258196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.268372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1103/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:51.748310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:51.762755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.778279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c989d-c196-403d-8f41-21e9c2d7c12e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:51.783984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:51.784999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.785597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.786071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] PATH_INFO: `/v3/projects/b92fa9f0512f40d59800413063f99149` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.787587 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92fa9f0512f40d59800413063f99149)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.789777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.903890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92fa9f0512f40d59800413063f99149', 'request_id': 'req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.916158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92fa9f0512f40d59800413063f99149', 'request_id': 'req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.931169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92fa9f0512f40d59800413063f99149', 'request_id': 'req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.993321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] The token cache is being invalidate because project b92fa9f0512f40d59800413063f99149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:51.994824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.994824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.996924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1134/2237] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:51 2022] DELETE /identity/v3/projects/b92fa9f0512f40d59800413063f99149 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:52.001252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.011385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662f1d-3594-407e-b57c-74977b3b5c93 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:52.067856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:52.068507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.068793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.069074 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] PATH_INFO: `/v3/users/8ccfb44d634241f89a014fc2da18b769` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.070288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccfb44d634241f89a014fc2da18b769)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:52.072213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:52.092481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:52.247876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccfb44d634241f89a014fc2da18b769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.248461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccfb44d634241f89a014fc2da18b769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.260616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccfb44d634241f89a014fc2da18b769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.261298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccfb44d634241f89a014fc2da18b769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.336566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b9fc9d61-8553-4b43-8080-548784252101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccfb44d634241f89a014fc2da18b769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.351093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1104/2238] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:52 2022] DELETE /identity/v3/users/8ccfb44d634241f89a014fc2da18b769 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:52.860548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.860548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:52.895705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2320fb-02e0-45e6-9e4d-f73a80e491d7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:52.926942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:52.991710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:52.992412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.992697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.992978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] PATH_INFO: `/v3/projects/a64e08bd79a44c75bfab88a5ed14b009` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.002005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64e08bd79a44c75bfab88a5ed14b009)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.005256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.127524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64e08bd79a44c75bfab88a5ed14b009', 'request_id': 'req-7e0639db-2d23-41b2-ada0-3b27fbff1a09'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:53.133912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64e08bd79a44c75bfab88a5ed14b009', 'request_id': 'req-7e0639db-2d23-41b2-ada0-3b27fbff1a09'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:53.139579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64e08bd79a44c75bfab88a5ed14b009', 'request_id': 'req-7e0639db-2d23-41b2-ada0-3b27fbff1a09'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:53.236050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] The token cache is being invalidate because project a64e08bd79a44c75bfab88a5ed14b009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:53.236360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:53.237030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7e0639db-2d23-41b2-ada0-3b27fbff1a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:53.239012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1135/2239] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:52 2022] DELETE /identity/v3/projects/a64e08bd79a44c75bfab88a5ed14b009 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:53.244053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.244525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.244604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.269538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:53.271708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.335295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1105/2240] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:53.343911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.344204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.344493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.375681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:53.376942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.384983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1136/2241] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:53.389942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.399639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67dd4f-96b5-4ad7-8438-6849c6329682 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.404537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.405151 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.405845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.405845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.406540 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:53.406847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.408448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.420854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1106/2242] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:53.425135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.435233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb9e8-37cd-42f9-acbd-6b6fee29ca88 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.440054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.440661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.440942 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.441216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.441916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.443958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.543746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1137/2243] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:53.545022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.555221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde185f-d963-4716-a414-bdc196173f69 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.627096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.627722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.628011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.628292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.628961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.630924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.741095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1107/2244] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:53.746036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.756374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9973-4c06-4bcd-b715-99d6b15ed802 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.760905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.762963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.762963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.762963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.762963 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.764363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.775174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1138/2245] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:53.779688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.790323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b17e-7f3d-4b23-868a-c64914dce588 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.796104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.796702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.796994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.797277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.798016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.799627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6be633-cc65-48e5-aa55-6eb9c2b1d5c4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.810911 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1108/2246] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:53.815147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.825125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dd4cb-858f-413a-98e8-8542928a40a9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.829565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.830247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.830547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.830808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] PATH_INFO: `/v3/projects/f5f3e0040cbd45aa9472938dbe81769c/users/85902ca89b154a4cb6b29422728f5c65/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.845965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f3e0040cbd45aa9472938dbe81769c, user_id=85902ca89b154a4cb6b29422728f5c65, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.848601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.926694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1139/2247] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:53 2022] PUT /identity/v3/projects/f5f3e0040cbd45aa9472938dbe81769c/users/85902ca89b154a4cb6b29422728f5c65/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:53.938867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.939204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.939489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.949194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.970406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] MFA Rules not processed for user `85902ca89b154a4cb6b29422728f5c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:53.971625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.056104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1109/2248] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:54.068411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.070571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.128806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:54.132636 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0aaa-322c-49c9-a691-c56e3c8c2989 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.137221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.137931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.138269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.138556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.147227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.148666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21669f37-ae3d-4354-a6a1-db318042652f service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.158731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1140/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:54.178651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.313604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39a3db-d396-4b21-be26-3022d2b851e1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.314326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.315108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.315466 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.316082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] PATH_INFO: `/v3/users/85902ca89b154a4cb6b29422728f5c65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.317414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85902ca89b154a4cb6b29422728f5c65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.319645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.509101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85902ca89b154a4cb6b29422728f5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.509818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85902ca89b154a4cb6b29422728f5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.524554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85902ca89b154a4cb6b29422728f5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.525300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85902ca89b154a4cb6b29422728f5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.606786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85902ca89b154a4cb6b29422728f5c65'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.620027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1110/2250] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:54 2022] DELETE /identity/v3/users/85902ca89b154a4cb6b29422728f5c65 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:54.625221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.625530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.625811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.645502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:54.646940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.712094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1141/2251] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:54.723881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.725294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.739430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:54.793373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099984-f43c-4bd6-a5d2-d4a4eb0528d9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.797400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.798140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.798820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.799407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.814675 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.816169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22a74-2165-4da9-ace7-948349f4f520 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.827222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1111/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:55.323622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.325226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.337371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f08a-1d03-4917-859d-cf13087b78eb None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.345726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.345726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.345726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.345726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] PATH_INFO: `/v3/projects/f5f3e0040cbd45aa9472938dbe81769c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.346276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f3e0040cbd45aa9472938dbe81769c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.347359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.499232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f3e0040cbd45aa9472938dbe81769c', 'request_id': 'req-18a3505c-3161-46cc-995e-6a8b5ef50608'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.506581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f3e0040cbd45aa9472938dbe81769c', 'request_id': 'req-18a3505c-3161-46cc-995e-6a8b5ef50608'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.514139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f3e0040cbd45aa9472938dbe81769c', 'request_id': 'req-18a3505c-3161-46cc-995e-6a8b5ef50608'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.578532 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] The token cache is being invalidate because project f5f3e0040cbd45aa9472938dbe81769c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:55.578824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.579459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-18a3505c-3161-46cc-995e-6a8b5ef50608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.581231 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1142/2253] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:55 2022] DELETE /identity/v3/projects/f5f3e0040cbd45aa9472938dbe81769c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:55.585926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.586413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.586541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.607406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:55.608528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.672791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1112/2254] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:55.680827 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.681199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.681554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.703706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:55.704928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.712850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1143/2255] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:55.717175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.727244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3f93c-8188-46e5-b1a3-7dc7bb9a9b60 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.732782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.733398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.733685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.733997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.734698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:55.735006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.736614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.749858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1113/2256] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:55.754204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.764857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92dc12-e21a-477c-9f5a-47e274d2cccd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.769624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.770284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.770652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.770861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.771625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.773646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.875983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1144/2257] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:55.880091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.890406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609a806-eb60-4e12-967b-9863108ce437 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.948272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.948902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.949189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.949525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.950328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.952322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.066393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1114/2258] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:56.067796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.079949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300050-2765-4615-821f-8ca5fe599c51 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.084699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.087647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.087647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.087647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.087647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.088480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.099573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1145/2259] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:56.103876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.115374 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c439-ec90-455c-814b-5ba2026fe07c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.127654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.128285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.128566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.128957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.129648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.131280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825daa-f8bd-42ac-a4e2-dbb51b5a90b6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.145026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1115/2260] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:56.149070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.160385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bce3a-a9e1-463e-be83-a44f647af172 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.165246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.165940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.166228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.166508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] PATH_INFO: `/v3/projects/1efbaced246741bc9fc354725db66011/users/6f847b23042046cbb2850f7a0e487e74/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.184783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efbaced246741bc9fc354725db66011, user_id=6f847b23042046cbb2850f7a0e487e74, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.188068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.299172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1146/2261] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:56 2022] PUT /identity/v3/projects/1efbaced246741bc9fc354725db66011/users/6f847b23042046cbb2850f7a0e487e74/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:56.309495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.309650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.309936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.339149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] MFA Rules not processed for user `6f847b23042046cbb2850f7a0e487e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:56.341105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.350020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.408298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1116/2262] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:56.425640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.427751 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.463569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.523800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0c85-c4b9-46a6-a3ce-10bfd76341ae admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.543413 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.544343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.545388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.545680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.577230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.587045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac2e18-e20f-4e5d-aa31-29d4c917a617 service glance] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.593533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1147/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:59.163542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:59.164923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.228294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13015ee-e35b-45dd-ac09-dc4b1f2073a4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:59.233401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:59.234061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.234343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.234616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] PATH_INFO: `/v3/users/7b8a3143ec5c43218553903db10dedfb` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.235754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8a3143ec5c43218553903db10dedfb)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:59.237660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:59.479955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8a3143ec5c43218553903db10dedfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.480647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8a3143ec5c43218553903db10dedfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.500150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8a3143ec5c43218553903db10dedfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.500924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8a3143ec5c43218553903db10dedfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.593800 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8a3143ec5c43218553903db10dedfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.608227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1117/2264] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:59 2022] DELETE /identity/v3/users/7b8a3143ec5c43218553903db10dedfb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:59.612433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.612926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.613009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.640639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:59.641968 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.709674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1148/2265] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:59.720309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:59.721709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.757130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:59.785705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d49b-0f20-4ff0-b3dd-4e31508d0355 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:59.789478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:59.790137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.790582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.790861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.802095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:59.803527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fe40d-9d7f-4e9d-a2e6-38573ef3da0b service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:59.814118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1118/2266] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:00.287722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:00.289332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:00.303548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cdb5d-30dc-448b-bb45-6d4810f7547b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:00.308934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:00.311854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:00.311854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:00.311854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] PATH_INFO: `/v3/projects/b7709a436485440aace7c238ee8494f3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:00.313022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7709a436485440aace7c238ee8494f3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:00.315685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:00.975494 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7709a436485440aace7c238ee8494f3', 'request_id': 'req-e044d791-625f-407c-bb0f-2c5ec20e4d41'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.983161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7709a436485440aace7c238ee8494f3', 'request_id': 'req-e044d791-625f-407c-bb0f-2c5ec20e4d41'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.989036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7709a436485440aace7c238ee8494f3', 'request_id': 'req-e044d791-625f-407c-bb0f-2c5ec20e4d41'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.069224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] The token cache is being invalidate because project b7709a436485440aace7c238ee8494f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:01.070581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.070581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e044d791-625f-407c-bb0f-2c5ec20e4d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.071789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1149/2267] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:00 2022] DELETE /identity/v3/projects/b7709a436485440aace7c238ee8494f3 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:01.077025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.077533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.077709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.097694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:01.105102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.162102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1119/2268] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:01.171373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.171664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.171945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.193136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:01.194459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.202726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1150/2269] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:01.207649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.218279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237868-3c5e-4a9e-b062-f5239057d170 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.223294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.223855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.224139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.224422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.225155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:01.225463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.227177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.244747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1120/2270] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:01.249181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.258937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5453f1b-1b88-4a55-825d-5fe5c1ab8c62 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.264960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.265597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.265939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.266242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.266916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.268866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.372522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1151/2271] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:01.376803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.387318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c39c0-cae2-4390-90b9-9c2123b95bf5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.462819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.463513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.463955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.464235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.466120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.467527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.613705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1121/2272] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:01.619185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.633237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828994a-9349-4113-af48-302ed4cfa77b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.639007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.640290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.640290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.640528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.641365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.643102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.646441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:01.657531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1152/2273] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:01.663617 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.683295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874a76-57cd-4c29-aeef-e5e153652f10 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.691935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.692611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.692903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.693202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.693930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.695574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83153b-b9c0-45f6-8cc3-1c167d138023 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.710296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1122/2274] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:01.714811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.728359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3bf0-39cf-4295-ad52-082c4f616eae admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.733905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.735821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.735821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.735821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] PATH_INFO: `/v3/projects/8f19c17b2ebe4eb9bf21ea3440988401/users/cca8ccda749c4254bc186598e1f645c2/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.777330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f19c17b2ebe4eb9bf21ea3440988401, user_id=cca8ccda749c4254bc186598e1f645c2, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.777330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.846310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1153/2275] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:01 2022] PUT /identity/v3/projects/8f19c17b2ebe4eb9bf21ea3440988401/users/cca8ccda749c4254bc186598e1f645c2/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:01.856743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be47e-a94f-4d70-b332-4a8bb161070f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.857713 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be47e-a94f-4d70-b332-4a8bb161070f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.858149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be47e-a94f-4d70-b332-4a8bb161070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.897532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-322be47e-a94f-4d70-b332-4a8bb161070f None None] MFA Rules not processed for user `cca8ccda749c4254bc186598e1f645c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:01.898839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-322be47e-a94f-4d70-b332-4a8bb161070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.944589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:01.994152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1123/2276] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:02.005341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.007298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.094229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd02da-a864-4f65-a117-2cd215304142 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.098477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.099250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.099454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.099730 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.110137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.111921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.126759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1154/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:06.241636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c399-c8da-4da5-b7a4-b00a5f9623fd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.242158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c399-c8da-4da5-b7a4-b00a5f9623fd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.242418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c399-c8da-4da5-b7a4-b00a5f9623fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.266350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8085c399-c8da-4da5-b7a4-b00a5f9623fd None None] MFA Rules not processed for user `cca8ccda749c4254bc186598e1f645c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:06.267576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8085c399-c8da-4da5-b7a4-b00a5f9623fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:06.276293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1124/2278] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:07.809682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:07.812552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:07.893820 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f18d5-a5a7-4eef-b4b3-c2eea60fdd7a service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:07.899033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:07.899749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:07.900038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:07.900374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] PATH_INFO: `/v3/users/76750323f4ff4ff7841bdce9c008c4df` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:07.901970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76750323f4ff4ff7841bdce9c008c4df)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:07.904242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:08.153773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76750323f4ff4ff7841bdce9c008c4df'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.154349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76750323f4ff4ff7841bdce9c008c4df'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.168261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76750323f4ff4ff7841bdce9c008c4df'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.176244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76750323f4ff4ff7841bdce9c008c4df'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.181666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:08.246660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76750323f4ff4ff7841bdce9c008c4df'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.256144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1155/2279] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:07 2022] DELETE /identity/v3/users/76750323f4ff4ff7841bdce9c008c4df => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:08.261034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82c644-2c20-4928-88e4-821499739394 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:08.261536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82c644-2c20-4928-88e4-821499739394 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:08.261647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82c644-2c20-4928-88e4-821499739394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:08.288397 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-de82c644-2c20-4928-88e4-821499739394 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:08.289851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-de82c644-2c20-4928-88e4-821499739394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:08.382425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1125/2280] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:08.393800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:08.395403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:08.458102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c97ae-037a-47d1-83ea-054e74ff5748 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:08.461835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:08.462523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:08.462882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:08.463233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:08.473566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:08.475039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:08.491286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1156/2281] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:08.852307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17bd9-b305-4114-8894-a4001b44556d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:08.852603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17bd9-b305-4114-8894-a4001b44556d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:08.852885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17bd9-b305-4114-8894-a4001b44556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:08.886213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f1a17bd9-b305-4114-8894-a4001b44556d None None] MFA Rules not processed for user `6b46ac5a29594c41a83e70838b0a13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:08.887429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f1a17bd9-b305-4114-8894-a4001b44556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:08.964714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1126/2282] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:08.995577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:08.995577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.006271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0cdb7-1f0b-48de-91da-1a9eb4fff347 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.010911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.011580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.012443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.012443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] PATH_INFO: `/v3/projects/1348997dbbb64a359f15fda93aa24a74` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.013316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1348997dbbb64a359f15fda93aa24a74)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.015383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.128003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1348997dbbb64a359f15fda93aa24a74', 'request_id': 'req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.134350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1348997dbbb64a359f15fda93aa24a74', 'request_id': 'req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.140767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1348997dbbb64a359f15fda93aa24a74', 'request_id': 'req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.215411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] The token cache is being invalidate because project 1348997dbbb64a359f15fda93aa24a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:09.215702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.216321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-551d89fa-d8e3-4cdc-8a3d-76775d7a96da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.218465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1157/2283] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:08 2022] DELETE /identity/v3/projects/1348997dbbb64a359f15fda93aa24a74 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:09.223507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.223801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.224078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.246147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:09.247290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.309265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1127/2284] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:09.317901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.318192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.318473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.339330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:09.340641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.349511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1158/2285] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:09.353846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.364059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2ec6-4af2-4428-b4ea-037b27d95062 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.368815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.369421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.369710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.370044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.370735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:09.371070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.372687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.374353 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:09.384823 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1128/2286] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:09.389457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.403675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d5eda-1b1a-4d83-9138-a05cdeb8b1c3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.409964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.410595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.410879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.411134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.411845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.413833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.540124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1159/2287] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:09.544580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.555631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fd99b-8dbf-4b82-aafb-6fe8fc597528 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.614520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.615141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.615450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.615721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.616371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.618576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.733191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1129/2288] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:09.738309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.751234 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acacb4-aa25-4972-a854-37996cdf899a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.756034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.756688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.756973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.757249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.757986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.759672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.770849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1160/2289] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:09.774943 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.788677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa511-7ece-4144-b357-34036af49f40 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.793516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.794127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.794414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.794693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.795475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.797066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2dff-ca2e-4b59-9083-1dd4e68e4850 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.807972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1130/2290] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:09.812698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.823427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa3547-1eee-4378-87c4-d9e1d6675464 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.829039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.829709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.830028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.830308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] PATH_INFO: `/v3/projects/fa09c57a87754355a1acb9531dbc8c03/users/efe9a86c81704c5b83ba9d47ddbc7eda/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.847243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa09c57a87754355a1acb9531dbc8c03, user_id=efe9a86c81704c5b83ba9d47ddbc7eda, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.849940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.905888 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1161/2291] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:09 2022] PUT /identity/v3/projects/fa09c57a87754355a1acb9531dbc8c03/users/efe9a86c81704c5b83ba9d47ddbc7eda/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:09.916969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.917333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.917687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.949225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] MFA Rules not processed for user `efe9a86c81704c5b83ba9d47ddbc7eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:09.950613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:10.017792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1131/2292] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:10.033641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.035392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:10.055417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:10.095925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5902704-6990-4b22-831f-419e7bf8d00c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.099563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.100610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.100902 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.101178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.111759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.119671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3846f03-c9a5-430c-a553-c7b82d71b935 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.124928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1162/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:12.445268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:12.446730 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:12.517534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6963-1dff-4873-b91f-3a28471d9c68 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:12.522162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:12.522813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:12.523112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:12.523383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] PATH_INFO: `/v3/users/afdc75134ecc4d26ab6c26de29f79d1b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:12.524558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdc75134ecc4d26ab6c26de29f79d1b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:12.526523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:12.532560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:12.699495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdc75134ecc4d26ab6c26de29f79d1b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:12.700076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdc75134ecc4d26ab6c26de29f79d1b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:12.714102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdc75134ecc4d26ab6c26de29f79d1b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:12.714873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdc75134ecc4d26ab6c26de29f79d1b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:12.767248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdc75134ecc4d26ab6c26de29f79d1b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:12.785953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1132/2294] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:12 2022] DELETE /identity/v3/users/afdc75134ecc4d26ab6c26de29f79d1b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:12.790504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:12.791005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:12.791098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:12.810278 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:12.811674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:12.873424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1163/2295] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:12.883986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:12.885944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:12.949797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1b45-6231-4ea1-91c6-b2104f326c81 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:12.953952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:12.954892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:12.958798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:12.958798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:12.965060 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:12.966634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:12.977314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1133/2296] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:13.290283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:13.291731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.304420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87047c-930d-48d1-b135-b2da1cb4188a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:13.308924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:13.309560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.309876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.310155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] PATH_INFO: `/v3/users/efe9a86c81704c5b83ba9d47ddbc7eda` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.311340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe9a86c81704c5b83ba9d47ddbc7eda)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:13.313267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:13.408701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:13.410162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.431031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5ff0-a60a-4da1-9898-2eb17b4482b0 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:13.437898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:13.438776 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.439226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.439669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] PATH_INFO: `/v3/projects/f1330feed97f43c08fbf9525adeea900` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.441263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1330feed97f43c08fbf9525adeea900)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:13.443496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:13.511158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe9a86c81704c5b83ba9d47ddbc7eda'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.511746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe9a86c81704c5b83ba9d47ddbc7eda'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.524618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe9a86c81704c5b83ba9d47ddbc7eda'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.532367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe9a86c81704c5b83ba9d47ddbc7eda'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.595411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1330feed97f43c08fbf9525adeea900', 'request_id': 'req-f6f921be-88b3-4e8e-aaee-1593ed972864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.600874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1330feed97f43c08fbf9525adeea900', 'request_id': 'req-f6f921be-88b3-4e8e-aaee-1593ed972864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.606958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1330feed97f43c08fbf9525adeea900', 'request_id': 'req-f6f921be-88b3-4e8e-aaee-1593ed972864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.610153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-88a03350-5e4d-414a-b5c1-65797af2b1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe9a86c81704c5b83ba9d47ddbc7eda'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.620519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1164/2297] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:13 2022] DELETE /identity/v3/users/efe9a86c81704c5b83ba9d47ddbc7eda => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:13.624713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.625023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.625305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.647173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:13.648450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.695710 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] The token cache is being invalidate because project f1330feed97f43c08fbf9525adeea900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:13.696203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.696339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:13.696919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.698652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1134/2298] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:13 2022] DELETE /identity/v3/projects/f1330feed97f43c08fbf9525adeea900 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:13.733464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1165/2299] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:13.745034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:13.746809 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.769400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:13.821278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f921be-88b3-4e8e-aaee-1593ed972864 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:13.882735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:13.883389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.883682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.883959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.894914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:13.898802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d954486-035b-43c4-99a2-863cd7a6c041 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:13.909784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1135/2300] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:14.354361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.355832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.373420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98285a-0b63-4494-9534-c8eac90d6321 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.381628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:14.382945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.383443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.383941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] PATH_INFO: `/v3/projects/fa09c57a87754355a1acb9531dbc8c03` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.385436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa09c57a87754355a1acb9531dbc8c03)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:14.387504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:14.519899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa09c57a87754355a1acb9531dbc8c03', 'request_id': 'req-a75abfdc-504c-4727-986d-c35b3d7e4a2f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.526117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa09c57a87754355a1acb9531dbc8c03', 'request_id': 'req-a75abfdc-504c-4727-986d-c35b3d7e4a2f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.532491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa09c57a87754355a1acb9531dbc8c03', 'request_id': 'req-a75abfdc-504c-4727-986d-c35b3d7e4a2f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.605695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] The token cache is being invalidate because project fa09c57a87754355a1acb9531dbc8c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:14.606018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.606641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a75abfdc-504c-4727-986d-c35b3d7e4a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.608146 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1166/2301] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:14 2022] DELETE /identity/v3/projects/fa09c57a87754355a1acb9531dbc8c03 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:14.614001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.614475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.614762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.637674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:14.640189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.709192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1136/2302] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:14.717062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.717355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.717639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.738720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:14.740028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.749111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1167/2303] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:14.754092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.763974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c2fc5-4fe4-4c1e-9589-a9572f73d604 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.769264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:14.769919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.770206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.770483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.771183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:14.771485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:14.773073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:14.785183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1137/2304] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:14.789809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.799806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beab517-a77a-4c0c-8ba8-73f90a257294 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.804739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:14.805397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.805682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.806005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.806679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:14.808653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:14.934656 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1168/2305] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:14 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:14.938068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.948186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11f77-38d1-4c1f-98b1-69e9f99402d7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.999687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:15.008677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.009297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.009581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.009899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.012482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.012482 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.124981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1138/2306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:14 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:15.129265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:15.139621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecae805-b7b4-4356-8319-adc3d549bd68 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:15.144938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.145538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.145914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.146220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.146906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.148486 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.160181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1169/2307] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:15.164652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:15.177454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0961-6c38-4ac5-91f5-be106eb87a26 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:15.182410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.183033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.183317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.183599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.184297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.186000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f8423-8f1b-4705-94bc-cbcb35a6f882 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.197712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1139/2308] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:15.202005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:15.213199 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269c340-853e-41fa-aeee-c9b1c58fca49 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:15.219673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.220440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.220723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.221000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] PATH_INFO: `/v3/projects/45a47df9696843c9a0bb6ee8d33e532c/users/efdd27ccca324dca9609028b7441824d/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.236696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a47df9696843c9a0bb6ee8d33e532c, user_id=efdd27ccca324dca9609028b7441824d, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.239440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.309287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1170/2309] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:15 2022] PUT /identity/v3/projects/45a47df9696843c9a0bb6ee8d33e532c/users/efdd27ccca324dca9609028b7441824d/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:15.321941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4ca0-0680-4a92-b0d1-8c707227626b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.322496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4ca0-0680-4a92-b0d1-8c707227626b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.322983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4ca0-0680-4a92-b0d1-8c707227626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.352729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-86fa4ca0-0680-4a92-b0d1-8c707227626b None None] MFA Rules not processed for user `efdd27ccca324dca9609028b7441824d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:15.354015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-86fa4ca0-0680-4a92-b0d1-8c707227626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:15.424142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1140/2310] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:15.434933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:15.436830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:15.495446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2e1b3-e901-4370-998a-53f3de7ba8d4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:15.499148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.499768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.500052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.500332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.506914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:15.509239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.510783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.522081 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1171/2311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:21.971828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.972282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.972391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.013398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:22.014295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.177062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1141/2312] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:22.235421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.237324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.355988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053497-3532-40c3-98c1-08d14e1881d7 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.361321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.361978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.362266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.366557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.379564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.381731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792084b-07e6-496e-bdbd-0857337fa574 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.394678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1172/2313] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:23:32.172181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:32.389091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=34 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:38.044277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.107537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54199cd1-3fa6-40b3-bf1c-7531e2f384c7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.112282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.113093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.113378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.113656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] PATH_INFO: `/v3/users/efdd27ccca324dca9609028b7441824d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.114983 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdd27ccca324dca9609028b7441824d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.117628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.322165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdd27ccca324dca9609028b7441824d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:38.322748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdd27ccca324dca9609028b7441824d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:38.335671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdd27ccca324dca9609028b7441824d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:38.336306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdd27ccca324dca9609028b7441824d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:38.405563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdd27ccca324dca9609028b7441824d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:38.418923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1142/2314] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:38 2022] DELETE /identity/v3/users/efdd27ccca324dca9609028b7441824d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:38.424819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.425330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.425485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.446433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:38.450266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:38.512138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1173/2315] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:38.522182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.523557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:38.583794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bed5d-fa5a-429f-baca-5f5be58731df admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.587606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.588233 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.588525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.588790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.598038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.600010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.610234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1143/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:39.058938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:39.060515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:39.073306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2bcd3-b088-4d22-ac43-c81703e9b5e9 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:39.078058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:39.078704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.078995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.079265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] PATH_INFO: `/v3/projects/45a47df9696843c9a0bb6ee8d33e532c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:39.080468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a47df9696843c9a0bb6ee8d33e532c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:39.082443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:39.186718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a47df9696843c9a0bb6ee8d33e532c', 'request_id': 'req-77934eb3-69a9-4b85-86b9-ee6c9acd4293'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.192794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a47df9696843c9a0bb6ee8d33e532c', 'request_id': 'req-77934eb3-69a9-4b85-86b9-ee6c9acd4293'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.198868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a47df9696843c9a0bb6ee8d33e532c', 'request_id': 'req-77934eb3-69a9-4b85-86b9-ee6c9acd4293'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.289082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] The token cache is being invalidate because project 45a47df9696843c9a0bb6ee8d33e532c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:39.289367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.290008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-77934eb3-69a9-4b85-86b9-ee6c9acd4293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.291536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1174/2317] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:39 2022] DELETE /identity/v3/projects/45a47df9696843c9a0bb6ee8d33e532c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:41.135410 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.136825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.186398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.236956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822b7b9-762c-4b57-8380-e7ef66037b4e service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.303103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.303712 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.303998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.304277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.306852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.319725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.321363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d29541-2692-4bb9-89d7-3bd190cc59b3 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.332488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1144/2318] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:44.017148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.017857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.017857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.019204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1175/2319] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:23:44.025856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119b2e-140a-4d75-a4cf-197d6ecc9594 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.026322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119b2e-140a-4d75-a4cf-197d6ecc9594 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.026611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119b2e-140a-4d75-a4cf-197d6ecc9594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.056695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ed119b2e-140a-4d75-a4cf-197d6ecc9594 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:44.056695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ed119b2e-140a-4d75-a4cf-197d6ecc9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.128505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1145/2320] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:44.140896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:44.142658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.201088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e431d9-9d7b-4668-8460-379a0cf8bacd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:44.204628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:44.205236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.205515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.205818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.215720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:44.218241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a181e-b697-43ce-8d04-8a72df8db650 service glance] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:44.227815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1176/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:44.430076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.430298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.430576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.431926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1146/2322] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:23:44.436708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbfff7-7c65-4064-85e7-d5f63c8b3793 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.437003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbfff7-7c65-4064-85e7-d5f63c8b3793 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.437287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbfff7-7c65-4064-85e7-d5f63c8b3793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.457313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f7dbfff7-7c65-4064-85e7-d5f63c8b3793 None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:44.462343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f7dbfff7-7c65-4064-85e7-d5f63c8b3793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.479519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:44.511423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1177/2323] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:44.523794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:44.526101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.539277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09959c-b43c-4ae1-a99e-bd691ba779a2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:44.542904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:44.543515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.543804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.544082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.551968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:44.553403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298274a3-499d-4968-bd7d-99708779ee15 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:44.561843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1147/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:44.713020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.713312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.713591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.714981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1178/2325] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:23:44.720894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.720993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.721385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.742796 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:44.744265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.757621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1148/2326] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:44.770382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:44.772857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:44.789723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf557e0-3cf3-448f-ad02-804c14015c45 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:44.793556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:44.794211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:44.794520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:44.794763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:44.807324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:44.808757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13a31c-223b-4adc-870e-00b60b24defc service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:44.820655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1179/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:47.356246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:47.358033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:47.389511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:47.426939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff6da7-fa22-445d-9874-5b84b7bb8e22 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:47.432387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:47.433040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:47.433328 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:47.433609 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] PATH_INFO: `/v3/users/6f847b23042046cbb2850f7a0e487e74` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:47.434824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f847b23042046cbb2850f7a0e487e74)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:47.436854 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:47.708798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f847b23042046cbb2850f7a0e487e74'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:47.709558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f847b23042046cbb2850f7a0e487e74'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:47.722865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f847b23042046cbb2850f7a0e487e74'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:47.723591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f847b23042046cbb2850f7a0e487e74'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:47.800278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f847b23042046cbb2850f7a0e487e74'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:47.813626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1149/2328] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:47 2022] DELETE /identity/v3/users/6f847b23042046cbb2850f7a0e487e74 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:47.818703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:47.819204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:47.819324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:47.838492 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:47.839713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:47.898996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1180/2329] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:47.908691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:47.910172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:47.967408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca918-1d50-4e44-8e0f-0558a9d243fb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:47.970957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:47.971575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:47.971860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:47.972137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:47.982114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:47.983523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53263903-861b-4cbf-bee3-c034c48ce224 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:47.993425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1150/2330] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:48.400705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:48.402173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:48.414686 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c43c1-36f6-4bb8-921a-4056af11ae9d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:48.419784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:48.420432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:48.420713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:48.421018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] PATH_INFO: `/v3/projects/1efbaced246741bc9fc354725db66011` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:48.422274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efbaced246741bc9fc354725db66011)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:48.424214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:48.553098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efbaced246741bc9fc354725db66011', 'request_id': 'req-680d73c9-cb56-4081-aa2c-11a8efd75b31'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:48.559365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efbaced246741bc9fc354725db66011', 'request_id': 'req-680d73c9-cb56-4081-aa2c-11a8efd75b31'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:48.564889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efbaced246741bc9fc354725db66011', 'request_id': 'req-680d73c9-cb56-4081-aa2c-11a8efd75b31'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:48.639867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] The token cache is being invalidate because project 1efbaced246741bc9fc354725db66011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:48.640161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:48.640813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-680d73c9-cb56-4081-aa2c-11a8efd75b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:48.642384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1181/2331] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:48 2022] DELETE /identity/v3/projects/1efbaced246741bc9fc354725db66011 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:48.647920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:48.648389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:48.648509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:48.670155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:48.671364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:48.741340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:48.757901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1151/2332] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:48.765362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:48.765659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:48.765989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:48.790427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:48.793130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:48.801541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1182/2333] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:48.811972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:48.821672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a366-d89a-4e62-b009-f5ad56d67d85 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:48.826475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:48.827192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:48.827678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:48.828190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:48.829223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:48.829536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:48.831200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:48.843775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1152/2334] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:48.848088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:48.858945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf1075-f36a-4b44-9d83-924e2e19ded7 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:48.863612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:48.864225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:48.864513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:48.865450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:48.866346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:48.868520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:48.948470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1183/2335] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:48 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:48.952512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:48.962705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c60f57-76e2-41cf-b5ef-275d9d51cf83 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:49.020349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:49.021101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.021551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.022002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.022677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:49.024582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:49.108921 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1153/2336] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:48 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:49.113182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:49.124545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a047aa-2ad7-465b-b6e4-2b2118d3c0d2 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:49.129233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:49.129912 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.130196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.130476 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.131493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:49.133100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:49.143161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1184/2337] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:49.147379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:49.157420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de74d5-2416-48f3-a90d-e6862f8d012d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:49.162565 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:49.163238 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.163517 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.163785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.164624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:49.166192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382d65f-53c4-491f-820a-ffc143bdda2a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:49.176764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1154/2338] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:49.181528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:49.191479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6fc74-6828-4ea2-8bf4-7ccfc62103ce admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:49.196774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:49.197426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.197710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.198014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] PATH_INFO: `/v3/projects/0befd807a6f941598b87bd4fc1849bee/users/00b8adaf307c4056ad34c2b45a258b0c/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.200233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:49.214835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0befd807a6f941598b87bd4fc1849bee, user_id=00b8adaf307c4056ad34c2b45a258b0c, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:49.217498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:49.325049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1185/2339] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:49 2022] PUT /identity/v3/projects/0befd807a6f941598b87bd4fc1849bee/users/00b8adaf307c4056ad34c2b45a258b0c/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:49.329658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.330012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.330318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.359761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] MFA Rules not processed for user `00b8adaf307c4056ad34c2b45a258b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:49.360994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:49.432033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1155/2340] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:23:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:49.444474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:49.445728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:49.502757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85465918-a370-4b5f-b746-46d491889e0a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:49.507165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:49.507784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:49.508070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:49.508350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:49.516734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:49.518206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393474bc-bd79-4dd7-9af8-aca48e7ca5c5 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:49.527898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1186/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:59.428593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:59.523678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:03.343295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:03.414808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:03.414808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:03.414808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:03.415419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347db1e1-ac7d-473d-952a-061a80eb8b3e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:03.418304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:03.418971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:03.419257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:03.419734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] PATH_INFO: `/v3/users/00b8adaf307c4056ad34c2b45a258b0c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:03.421097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b8adaf307c4056ad34c2b45a258b0c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:03.423157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:03.437554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:03.439063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:03.504650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1187/2342] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:24:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:03.522421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:03.524634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:03.607867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8b4e-b6af-4a9e-94a7-17945a41b378 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:03.618853 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:03.619778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:03.620240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:03.621083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:03.626973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b8adaf307c4056ad34c2b45a258b0c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:03.628564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b8adaf307c4056ad34c2b45a258b0c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:03.631873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:03.634006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9664c-e403-4070-a258-7f5763428eb3 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:03.648088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1188/2343] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:24:03.654493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b8adaf307c4056ad34c2b45a258b0c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:03.657296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b8adaf307c4056ad34c2b45a258b0c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:03.763307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b8adaf307c4056ad34c2b45a258b0c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:03.790184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1156/2344] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:03 2022] DELETE /identity/v3/users/00b8adaf307c4056ad34c2b45a258b0c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:03.792641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:03.793018 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:03.793397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:03.822284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:03.823597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:03.891425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1189/2345] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:03.902273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:03.909422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:03.976316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789404-4847-4e28-9a19-e1dcef85cab9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:03.980075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:03.980769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:03.981041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:03.981317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:03.991120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:03.992889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f98061-0395-48d0-bab8-2db4f1347c62 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:04.003194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1157/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:04.465669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:04.465669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.477825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912eadf-daba-49bb-99e2-c80d0e491ca1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:04.483328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:04.484369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:04.484502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:04.484778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] PATH_INFO: `/v3/projects/0befd807a6f941598b87bd4fc1849bee` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:04.486273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0befd807a6f941598b87bd4fc1849bee)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:04.488205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:04.549705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:04.550222 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:04.550331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:04.569390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:04.570632 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.588363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:04.592638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:04.606435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0befd807a6f941598b87bd4fc1849bee', 'request_id': 'req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:04.612944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0befd807a6f941598b87bd4fc1849bee', 'request_id': 'req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:04.619356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0befd807a6f941598b87bd4fc1849bee', 'request_id': 'req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:04.628888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1158/2347] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:04.641361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:04.642758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.707857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] The token cache is being invalidate because project 0befd807a6f941598b87bd4fc1849bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:04.711978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:04.711978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c1ebbe84-f1dc-4962-b6db-2c7c217f4895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:04.711978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1190/2348] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:04 2022] DELETE /identity/v3/projects/0befd807a6f941598b87bd4fc1849bee => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:04.716925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c428f-fad9-41d0-a6a6-48fa91d44864 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:04.735362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:04.735748 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:04.736100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:04.767034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:04.768383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.792604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:04.793257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:04.793951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:04.794075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:04.796262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.868639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:04.878111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c020526-347a-491e-b53b-3665de2bf9de service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:04.879315 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1191/2349] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:04.887152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1159/2350] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:24:04.899283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:04.901348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:04.926600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc16a17-1895-43fb-94a4-c6bb10faf2e6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:04.933536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:04.934204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:04.934497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:04.934778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:04.944652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:04.946305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:04.955201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1192/2351] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:05.684183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a54d-f608-48ca-95eb-546413d6dfef None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:05.684638 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a54d-f608-48ca-95eb-546413d6dfef None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:05.684743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a54d-f608-48ca-95eb-546413d6dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:05.704745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-15e7a54d-f608-48ca-95eb-546413d6dfef None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:05.706088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-15e7a54d-f608-48ca-95eb-546413d6dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:05.714584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1160/2352] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:05.732338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:05.736931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8491666-189a-4eb0-a79c-e0d4bfc1ebe9 service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:05.743001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:05.743608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:05.743892 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:05.744164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:05.752839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:05.754448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:05.763148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1193/2353] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:06.339782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:06.340039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:06.340324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:06.358143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:06.361291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:06.362550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:06.377766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1161/2354] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:06.398434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:06.416923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3d83-8df7-4220-8988-2d832231f868 service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:06.423598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:06.424305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:06.424594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:06.424877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:06.436597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:06.438441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d780-1478-4230-8ab5-cd88f33d4182 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:06.448786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1194/2355] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:09.408170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:09.416682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:09.494117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437e97-c5c4-429e-89fa-feaac1640bc4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:09.502092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:09.502991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:09.503464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:09.503746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] PATH_INFO: `/v3/users/cca8ccda749c4254bc186598e1f645c2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:09.505007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca8ccda749c4254bc186598e1f645c2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:09.507651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:09.697645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca8ccda749c4254bc186598e1f645c2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:09.699136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca8ccda749c4254bc186598e1f645c2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:09.714183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca8ccda749c4254bc186598e1f645c2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:09.715021 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca8ccda749c4254bc186598e1f645c2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:09.805570 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca8ccda749c4254bc186598e1f645c2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:09.824064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1162/2356] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:09 2022] DELETE /identity/v3/users/cca8ccda749c4254bc186598e1f645c2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:09.829171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:09.829830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:09.829947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:09.850107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:09.851333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:09.916983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1195/2357] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:09.926696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:09.928928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:09.985229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a96905-25ab-482d-9ddd-106484f8591b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:09.988834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:09.989564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:09.990447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:09.990732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.001221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:10.003049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aecb47-44f0-4c73-b1ee-99ca1f95912d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:10.015870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1163/2358] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:10.260336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:10.261805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:10.274783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259d4e-e2b8-4df3-9d67-d533a46ab41e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:10.280953 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:10.281621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.281941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.282223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] PATH_INFO: `/v3/projects/8f19c17b2ebe4eb9bf21ea3440988401` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.283456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f19c17b2ebe4eb9bf21ea3440988401)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:10.285403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:10.318332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:10.412175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f19c17b2ebe4eb9bf21ea3440988401', 'request_id': 'req-a6ba9ded-e411-4b22-af15-5e76380b4b0f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:10.419432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f19c17b2ebe4eb9bf21ea3440988401', 'request_id': 'req-a6ba9ded-e411-4b22-af15-5e76380b4b0f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:10.438385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f19c17b2ebe4eb9bf21ea3440988401', 'request_id': 'req-a6ba9ded-e411-4b22-af15-5e76380b4b0f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:10.530109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] The token cache is being invalidate because project 8f19c17b2ebe4eb9bf21ea3440988401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:10.530326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:10.531076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a6ba9ded-e411-4b22-af15-5e76380b4b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:10.532784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1196/2359] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:10 2022] DELETE /identity/v3/projects/8f19c17b2ebe4eb9bf21ea3440988401 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:10.539175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.539753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.539958 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.560532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:10.561910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:10.577106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:10.632621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1164/2360] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:10.641911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.642429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.642782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.664919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:10.666419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:10.674707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1197/2361] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:10.679895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:10.689925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67958f-47dd-4598-9fbb-458dc5cba379 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:10.695507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:10.696142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.696437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.696721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.697428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:10.697735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:10.699382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:10.714526 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1165/2362] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:24:10.718286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:10.729450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81abba-af4d-4a1d-b262-2672eb694e55 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:10.749453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:10.750181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.750502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.750781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.751466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:10.753420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:10.850685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1198/2363] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:10 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:10.854725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:10.866404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8cc1-102e-46b3-84ef-b7cbdae04cdd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:10.957014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:10.957969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:10.958828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:10.959249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:10.962561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:10.965041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:11.089179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1166/2364] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:10 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:11.094629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:11.106028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9671-b2c9-4333-88d1-d45a6df79608 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:11.111671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:11.112375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:11.112700 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:11.112973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:11.113734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:11.115534 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:11.128109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1199/2365] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:11.134910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:11.145532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60675d47-ca72-4b9d-a242-55a9b0af1674 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:11.151548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:11.152174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:11.152460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:11.152738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:11.153443 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:11.155082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36caea8-7847-4487-97c1-4d2056763b9c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:11.168615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1167/2366] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:11.173141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:11.185288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ef86-2db4-4a5e-8dda-570bd5740122 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:11.190126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:11.190801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:11.191084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:11.191360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] PATH_INFO: `/v3/projects/db93edb25bd44f3d807734e521bc25c9/users/fda4d439d7584c5492d32f870f699333/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:11.207131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db93edb25bd44f3d807734e521bc25c9, user_id=fda4d439d7584c5492d32f870f699333, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:11.209922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:11.304867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1200/2367] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:11 2022] PUT /identity/v3/projects/db93edb25bd44f3d807734e521bc25c9/users/fda4d439d7584c5492d32f870f699333/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:11.315855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:11.316143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:11.316401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:11.361145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] MFA Rules not processed for user `fda4d439d7584c5492d32f870f699333`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:11.362373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:11.438829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1168/2368] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:11.451560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:11.454147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:11.541739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b45065-8693-49f0-9d90-b0a3e2e734b4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:11.556115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:11.556865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:11.557216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:11.557561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:11.568664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:11.570470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f3dd-0aa3-4d2a-92ef-dabfa6ecacaa service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:11.586765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1201/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:21.435529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:21.487929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:21.555161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac56239-274d-4d97-816e-09279dc5c056 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:21.560087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:21.564310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.564310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.564310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] PATH_INFO: `/v3/users/fda4d439d7584c5492d32f870f699333` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.564310 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda4d439d7584c5492d32f870f699333)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:21.564694 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:21.582417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:21.745948 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda4d439d7584c5492d32f870f699333'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.746608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda4d439d7584c5492d32f870f699333'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.762023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda4d439d7584c5492d32f870f699333'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.767633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda4d439d7584c5492d32f870f699333'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.850826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda4d439d7584c5492d32f870f699333'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.865587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1169/2370] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:21 2022] DELETE /identity/v3/users/fda4d439d7584c5492d32f870f699333 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:21.871265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.871727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.872011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.891719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:21.892819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:21.956214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1202/2371] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:21.967780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:21.969187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:22.027518 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a5a7-de6f-4009-8f51-74d9d734de69 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.031091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.031703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.031979 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.032252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.041998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.043437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11140-ea39-4902-9aef-043a057e6d90 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.053687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1170/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:22.473729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.475410 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:22.487837 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b7a4c-85d4-484b-93ab-656a81721abe None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.494004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.494662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.494949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.495226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] PATH_INFO: `/v3/projects/db93edb25bd44f3d807734e521bc25c9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.496425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] RBAC: Authorizing `identity:delete_project(project_id=db93edb25bd44f3d807734e521bc25c9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.498395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.622986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db93edb25bd44f3d807734e521bc25c9', 'request_id': 'req-2c64fcf7-f002-4102-8019-3f50df9914be'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:22.629354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db93edb25bd44f3d807734e521bc25c9', 'request_id': 'req-2c64fcf7-f002-4102-8019-3f50df9914be'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:22.636017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db93edb25bd44f3d807734e521bc25c9', 'request_id': 'req-2c64fcf7-f002-4102-8019-3f50df9914be'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:22.706861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] The token cache is being invalidate because project db93edb25bd44f3d807734e521bc25c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:22.707154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:22.707777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:22.709345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1203/2373] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:22 2022] DELETE /identity/v3/projects/db93edb25bd44f3d807734e521bc25c9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:32.048564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:32.703770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:34.357226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f245-b70f-4df3-80af-caa368abc642 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:34.357885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f245-b70f-4df3-80af-caa368abc642 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:34.357885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f245-b70f-4df3-80af-caa368abc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:34.379205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-96a9f245-b70f-4df3-80af-caa368abc642 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:34.381309 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-96a9f245-b70f-4df3-80af-caa368abc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:34.437326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1171/2374] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:34.459359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:34.460898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:34.532780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64fcf7-f002-4102-8019-3f50df9914be admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:34.538026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:34.538662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:34.538947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:34.539221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:34.547828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:34.549411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:34.565383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1204/2375] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:38.197055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dbee-1b48-4458-8dab-14330f11f1f9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.197504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dbee-1b48-4458-8dab-14330f11f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.197690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dbee-1b48-4458-8dab-14330f11f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.217110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-deb4dbee-1b48-4458-8dab-14330f11f1f9 None None] MFA Rules not processed for user `0097e07390144f3a804eb5057c6b75e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:38.218442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-deb4dbee-1b48-4458-8dab-14330f11f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:38.273434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1172/2376] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:44.555987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=32 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:48.266050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=50 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:26.090621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:26.092151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:26.147107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63177798-c885-43b4-a211-97f78882c0dd service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:26.150694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:26.151305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:26.151589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:26.151947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:26.154248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:26.223639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:26.225080 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:26.235877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1205/2377] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:27.542241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:27.542802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:27.542908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:27.563665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] MFA Rules not processed for user `6b46ac5a29594c41a83e70838b0a13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:27.564924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:27.620986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1173/2378] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:27.679627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:27.681028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:27.742651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104fad-26e2-4a01-9f1e-71712364923e service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:27.746557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:27.747895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:27.748458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:27.748864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:27.750633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:27.766781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:27.768225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ed44-1585-43a2-8a2b-c8a06ee16bd2 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:27.780067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1206/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:37.614223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=25 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:37.774819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=80 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:39.116871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:39.132036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886e86-d7cb-4f21-b2f1-aa0db3f830ba None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:39.136982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:39.138975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:39.139434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:39.139895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:39.142636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:39.216553 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:39.218025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:39.227538 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1174/2380] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:25:42.468589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:42.469113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:42.471256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:42.489706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] MFA Rules not processed for user `14c4c1027d8a42c081d69fa821216675`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:42.490971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:42.498767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1207/2381] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:42.827782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:42.838476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31a81-3a97-4089-8e75-94d841147eaa service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:42.842582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:42.843211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:42.843498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:42.843778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:42.845585 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:42.856627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:42.858153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:42.867463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1175/2382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:43.278311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:43.280772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:43.353982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb825-23a5-46fc-8f4d-b38e01efc0f3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:43.360111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:43.360780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:43.361099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:43.361373 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:43.363222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:43.375637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:43.378609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f8d34-8cd5-476c-8175-4cf69646e554 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:43.387276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1208/2383] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:44.064036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:44.065688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:44.079477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6815-d112-4bfa-96ac-351fc13c8f7e service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:44.083606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:44.084327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:44.084643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:44.084918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:44.086783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:44.148248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:44.151516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165616e-27c0-444c-8a85-74a07ef833f9 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:44.161351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1176/2384] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:47.311035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdbe9f-63dc-4780-abe0-50e143301bc7 None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:47.312100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdbe9f-63dc-4780-abe0-50e143301bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:47.312100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdbe9f-63dc-4780-abe0-50e143301bc7 None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:47.313313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1209/2385] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:25:47.326163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:47.328180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:47.328738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:47.353906 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] MFA Rules not processed for user `429f98d35a844c0190fcc7aca87e2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:47.355450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:47.366113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1177/2386] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:47.602790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdbe9f-63dc-4780-abe0-50e143301bc7 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:47.623539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdbe9f-63dc-4780-abe0-50e143301bc7 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:47.629598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:47.630653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:47.631032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:47.631409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:47.642195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:47.643907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:47.655063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1210/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:47.723584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:47.725326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:47.832174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3207b-1e26-403d-b038-6918779123bd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:47.836768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:47.837923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:47.837923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:47.838140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] PATH_INFO: `/v3/users/0097e07390144f3a804eb5057c6b75e5` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:47.839164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0097e07390144f3a804eb5057c6b75e5)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:47.841091 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:47.869883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:48.044656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0097e07390144f3a804eb5057c6b75e5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.045874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0097e07390144f3a804eb5057c6b75e5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.059308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0097e07390144f3a804eb5057c6b75e5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.060044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0097e07390144f3a804eb5057c6b75e5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.163525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d18a7e77-fdb1-4a35-a86a-50b871346988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0097e07390144f3a804eb5057c6b75e5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.176938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1178/2388] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:25:47 2022] DELETE /identity/v3/users/0097e07390144f3a804eb5057c6b75e5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:48.423965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:48.440774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b1aea-f6e9-42f2-a9b5-b83ed7ce26d6 service placement] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:48.515863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:48.516629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:48.517033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:48.517412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] PATH_INFO: `/v3/projects/714cc98080ae4baaa11b8b946c67ba2c` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:48.531347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=714cc98080ae4baaa11b8b946c67ba2c)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:48.533608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:48.685238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714cc98080ae4baaa11b8b946c67ba2c', 'request_id': 'req-2c736d1d-b378-4f58-80f7-300cdb6be39e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.690843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714cc98080ae4baaa11b8b946c67ba2c', 'request_id': 'req-2c736d1d-b378-4f58-80f7-300cdb6be39e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.707065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714cc98080ae4baaa11b8b946c67ba2c', 'request_id': 'req-2c736d1d-b378-4f58-80f7-300cdb6be39e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.825563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:48.833947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] The token cache is being invalidate because project 714cc98080ae4baaa11b8b946c67ba2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:25:48.833947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.834787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2c736d1d-b378-4f58-80f7-300cdb6be39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:48.836697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1211/2389] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:25:48 2022] DELETE /identity/v3/projects/714cc98080ae4baaa11b8b946c67ba2c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:48.841838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:48.843707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:48.844049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:48.875698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:48.875933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:48.964595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1179/2390] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:48.973568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:48.973897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:48.976899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.002642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:49.002642 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:49.013383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1212/2391] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:25:49.018449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.028752 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c228f-f6af-4a1a-a6ae-174a47452f44 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.035172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.035808 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.036095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.036372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.037124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:25:49.037424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.039054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.069793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1180/2392] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:25:49.074147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.084101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd1b02-6dcc-4c69-89ed-d20aa025baed None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.090000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.093610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.093610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.093610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.093610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.095810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.211834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1213/2393] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:25:49 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:49.215756 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.227750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818962c-7e17-4815-aace-dd5d8065feee admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.301869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.302508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.302869 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.303225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.303970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.306114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.416319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1181/2394] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:25:49 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:49.421263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.433540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7561-3d31-4a2f-a5e1-1fc43859e2e0 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.438867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.441577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.441577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.441577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.441577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.443423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.457279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1214/2395] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:49.458525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.470552 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c4f5-c219-408f-bcf9-7c383a02e667 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.475881 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.476599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.476873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.477161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.478011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.479556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb25526-2c37-4653-950b-7278e3fb6d4f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.492083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1182/2396] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:49.496132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.507192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c8bed-e58a-49c8-ab55-02ecba50f723 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.511992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.512733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.513020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.513372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] PATH_INFO: `/v3/projects/c982cea0e664473ca8df5da87fbe6d73/users/cb2ef56494054dd2ac1c18bee82f2a25/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.533798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c982cea0e664473ca8df5da87fbe6d73, user_id=cb2ef56494054dd2ac1c18bee82f2a25, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.534139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.719878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1215/2397] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:25:49 2022] PUT /identity/v3/projects/c982cea0e664473ca8df5da87fbe6d73/users/cb2ef56494054dd2ac1c18bee82f2a25/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:49.725641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69defb-8373-4c47-9b9f-7dbdf074edfe None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.726167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69defb-8373-4c47-9b9f-7dbdf074edfe None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.726602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69defb-8373-4c47-9b9f-7dbdf074edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.747670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:49.765377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fe69defb-8373-4c47-9b9f-7dbdf074edfe None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:49.766727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fe69defb-8373-4c47-9b9f-7dbdf074edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:49.836902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1183/2398] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:25:49.848099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:49.850592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:49.943158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba32df-428e-436c-a21c-e06a7db3e8dc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:49.947240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:49.947864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:49.948179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:49.948456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:49.958347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:49.959788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:49.971094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1216/2399] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:54.830571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70764-0a57-4276-936d-349c860902f6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:54.831125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70764-0a57-4276-936d-349c860902f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:54.831125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70764-0a57-4276-936d-349c860902f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:54.853684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cba70764-0a57-4276-936d-349c860902f6 None None] MFA Rules not processed for user `47da4644803547869a303a039ee7a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:54.854968 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cba70764-0a57-4276-936d-349c860902f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:54.930439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1184/2400] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:56.725380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:56.734984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed939ed-6683-4387-bc9a-42f6a378cc40 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:56.738811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:56.739465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:56.739939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:56.740403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:56.744211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:56.760155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:56.762426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:56.772589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1217/2401] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:25:57.080792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.081236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.081329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.117729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] MFA Rules not processed for user `cb2ef56494054dd2ac1c18bee82f2a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:57.119033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:57.189066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1185/2402] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:25:57.193818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.205455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04749a7f-683d-4153-a2ca-37e4b484ba7d service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.210480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.211094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.211378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.211679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.212355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.214397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.303243 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1218/2403] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:25:57 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:57.307490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.319259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656b997-670b-4d2a-bb64-20e5762d9c4d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.358150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:57.382042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.382672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.382959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.383239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.383936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.385923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.468974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1186/2404] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:25:57 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:57.470506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.481428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c31d8-c13a-4804-a70d-136f7d3b7ea4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.486739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.487380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.487740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.488034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.488733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.497695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.503276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1219/2405] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:57.513174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.525270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743ddf-5627-4254-ad78-d4fc1849e434 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.530128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.531012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.531363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.531708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] PATH_INFO: `/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582/users/e27dbc92493449dfac4538afb6f061c6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.552058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b593a17c67e1449eaeeb3cd10cb5d582, user_id=e27dbc92493449dfac4538afb6f061c6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.554915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.627545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1187/2406] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:25:57 2022] PUT /identity/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582/users/e27dbc92493449dfac4538afb6f061c6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:57.631427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.642436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026de-43fd-4cfd-aa00-d0eeb42a4752 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.696562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:57.706960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.707797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.708083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.708362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.709054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.710681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.720734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1220/2407] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:57.724864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:57.744061 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f417-4181-42ab-9ed8-424168e48d54 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:57.750952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:57.751642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:57.752044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:57.752334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] PATH_INFO: `/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582/users/e27dbc92493449dfac4538afb6f061c6/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:57.754608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b593a17c67e1449eaeeb3cd10cb5d582, user_id=e27dbc92493449dfac4538afb6f061c6, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:57.757402 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d0e1b-fc7c-4c76-9896-fbfa8e9bdd71 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:57.776255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1188/2408] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:25:57 2022] PUT /identity/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582/users/e27dbc92493449dfac4538afb6f061c6/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:03.478125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:03.481141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:03.621028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799677db-ed78-42b2-b0a7-ca28fe8c967e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:03.708556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:03.709111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:03.709400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:03.709683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:03.712240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:03.726338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:03.728155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:03.740224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1221/2409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:05.803510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.803952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.803952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.850234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] MFA Rules not processed for user `e27dbc92493449dfac4538afb6f061c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:05.851476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.966042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1189/2410] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:05.987571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:05.988863 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:06.003475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56f5a-80ba-4810-8138-f7dcb5373fa5 service nova] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:06.009622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:06.010398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:06.010893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:06.011169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:06.080099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:06.081701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7106c-a1ca-46a2-80fc-6822612b6776 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:06.091457 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1222/2411] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:06.171095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:06.172614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:06.240337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b645b3-e9bb-4e61-b4ef-91084aded59d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:06.244423 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:06.245052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:06.245334 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:06.245612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:06.247439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:06.278158 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:06.307082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:06.308495 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:06.318771 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1190/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:08.967336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:08.968155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:08.968155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:08.990790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] MFA Rules not processed for user `cb2ef56494054dd2ac1c18bee82f2a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:08.992386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:09.001295 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1223/2413] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:16.453138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=14 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:18.233964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:18.247307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0eba-3873-456a-b37c-881f32f2e759 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:18.254057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:18.257603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:18.257603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:18.257603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:18.257603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:18.273801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:18.276264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:18.301818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1191/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:18.984436 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:27.070235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:27.071652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:27.128589 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf50ee-2492-40cf-8434-34472749dadc None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:27.132097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:27.132701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:27.132981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:27.133254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:27.134951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:27.145306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:27.146742 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:27.155464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1224/2415] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:28.285693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:31.080636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:31.089859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b234be-c7dd-4299-a627-dce4bea7ee3b service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:31.093509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:31.094187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:31.094468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:31.094741 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:31.096478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:31.159358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:31.160798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:31.171130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1192/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:35.033442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:35.034919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:35.105518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71034-314a-46a1-93eb-bcd1f4af5d13 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:35.123070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:35.123070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:35.123070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:35.123070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:35.124148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:35.134358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:35.135952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:35.152015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1225/2417] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:35.159999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:35.161455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:35.179947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f348-a958-4382-9d0e-f52c019c7c2e service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:35.185058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:35.186499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:35.186938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:35.187223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] PATH_INFO: `/v3/users/6b46ac5a29594c41a83e70838b0a13c8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:35.188635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b46ac5a29594c41a83e70838b0a13c8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:35.190663 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:35.456883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b46ac5a29594c41a83e70838b0a13c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:35.457463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b46ac5a29594c41a83e70838b0a13c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:35.469728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b46ac5a29594c41a83e70838b0a13c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:35.470399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b46ac5a29594c41a83e70838b0a13c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:35.561167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-32111810-e2ae-472e-95de-60a737c4c899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b46ac5a29594c41a83e70838b0a13c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:35.574404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1193/2418] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:35 2022] DELETE /identity/v3/users/6b46ac5a29594c41a83e70838b0a13c8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:35.827330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:35.838220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45da4b-55e8-4e70-9998-6e95852829fe service placement] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:35.905530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:35.906226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:35.906511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:35.906790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] PATH_INFO: `/v3/projects/c80bd4eb290541d8a713ea5ba60d0de4` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:35.907975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80bd4eb290541d8a713ea5ba60d0de4)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:35.909919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.054935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:36.063799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80bd4eb290541d8a713ea5ba60d0de4', 'request_id': 'req-7937fb36-b95d-4dd9-95b5-1b53affea461'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:36.069816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80bd4eb290541d8a713ea5ba60d0de4', 'request_id': 'req-7937fb36-b95d-4dd9-95b5-1b53affea461'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:36.075407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80bd4eb290541d8a713ea5ba60d0de4', 'request_id': 'req-7937fb36-b95d-4dd9-95b5-1b53affea461'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:36.195792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] The token cache is being invalidate because project c80bd4eb290541d8a713ea5ba60d0de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:36.196083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:36.196707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-7937fb36-b95d-4dd9-95b5-1b53affea461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:36.198356 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1226/2419] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:35 2022] DELETE /identity/v3/projects/c80bd4eb290541d8a713ea5ba60d0de4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:36.204574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.205064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.205182 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.225440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:36.233003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:36.294597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1194/2420] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:36.303060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.303353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.303632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.324657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:36.325909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:36.337667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1227/2421] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:36.342216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.351946 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bedd0-0d41-46f1-8079-158d550062d1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.356622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.357234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.357521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.358046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.358804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:26:36.359109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.360717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.362706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:36.374272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1195/2422] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:26:36.378883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.388631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d40a34-c957-416e-a523-8ed1b2eec8b1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.394178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.394792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.395078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.395349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.396028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.398313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.502006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1228/2423] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:36 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:36.507513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.518115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe912a-5942-407f-906e-c58c98514513 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.574221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.574762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.575045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.575322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.575992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.579031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.657821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1196/2424] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:36 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:36.662015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.673114 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf531-f369-460d-a08c-bb2b619d0833 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.677832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.678441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.678726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.678999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.679691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.681341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.692272 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1229/2425] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:36.696138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.706113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6f3d6-59d0-402a-9f03-c9e538a65c57 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.710734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.711337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.711620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.711895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.712577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.714199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6005680-cad2-4cf3-9153-6ab744ec27fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.725786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1197/2426] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:36.729673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.740184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6978-d088-4721-b0a8-256450f53a2f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:36.745333 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:36.746088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.746374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.746652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] PATH_INFO: `/v3/projects/eb1cb4944c984608b88682621cead755/users/a4f87807459e41f685f4c38724424e6f/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.762193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1cb4944c984608b88682621cead755, user_id=a4f87807459e41f685f4c38724424e6f, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:36.765407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:36.861355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1230/2427] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:36 2022] PUT /identity/v3/projects/eb1cb4944c984608b88682621cead755/users/a4f87807459e41f685f4c38724424e6f/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:36.873075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:36.874009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:36.874294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:36.901339 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] MFA Rules not processed for user `a4f87807459e41f685f4c38724424e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:36.902614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:36.967358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1198/2428] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:36.978424 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:36.980150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:37.054563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce551-0122-4955-98da-de4ad6b03d1a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:37.060061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:37.060683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.060945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.061216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.068718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:37.070321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d5339-9cc8-4c6a-a34e-c8d069742c5c service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:37.078994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1231/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:37.293239 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:37.355058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273073a-a8a9-4f41-a867-b024761210a2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:37.359689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:37.360325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.360611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.360886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] PATH_INFO: `/v3/users/a4f87807459e41f685f4c38724424e6f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.362404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f87807459e41f685f4c38724424e6f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:37.364370 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:37.367046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:37.577018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f87807459e41f685f4c38724424e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:37.577864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f87807459e41f685f4c38724424e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:37.590766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f87807459e41f685f4c38724424e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:37.591532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f87807459e41f685f4c38724424e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:37.671616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f87807459e41f685f4c38724424e6f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:37.685351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1199/2430] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:37 2022] DELETE /identity/v3/users/a4f87807459e41f685f4c38724424e6f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:37.691094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.691385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.691665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.710347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:37.711533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:37.753013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:37.771504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1232/2431] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:37.782042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:37.783735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:37.840841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c8eb-ce87-42da-8888-b1f15bf29815 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:37.845542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:37.846210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.846500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.846782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.855892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:37.857321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca38b7-2a86-471d-9421-cdf2f19fa684 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:37.868114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1200/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:38.288709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:38.290261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:38.302930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e0953-dbe8-4f8c-b1d2-92420a683268 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:38.307796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:38.308453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.308740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.309019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] PATH_INFO: `/v3/projects/eb1cb4944c984608b88682621cead755` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.310212 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1cb4944c984608b88682621cead755)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:38.312781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:38.431331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1cb4944c984608b88682621cead755', 'request_id': 'req-a00c8a47-50bf-4306-a012-9520c72c121e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:38.438062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1cb4944c984608b88682621cead755', 'request_id': 'req-a00c8a47-50bf-4306-a012-9520c72c121e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:38.444992 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1cb4944c984608b88682621cead755', 'request_id': 'req-a00c8a47-50bf-4306-a012-9520c72c121e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:38.534131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] The token cache is being invalidate because project eb1cb4944c984608b88682621cead755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:38.534429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:38.535078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a00c8a47-50bf-4306-a012-9520c72c121e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:38.536605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1233/2433] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:38 2022] DELETE /identity/v3/projects/eb1cb4944c984608b88682621cead755 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:38.541525 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa69-d901-4317-921c-191e9426704c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.542029 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa69-d901-4317-921c-191e9426704c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.542201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa69-d901-4317-921c-191e9426704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.562610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-aad3fa69-d901-4317-921c-191e9426704c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:38.563815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aad3fa69-d901-4317-921c-191e9426704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:38.622418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1201/2434] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:38.630758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.631049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.631343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.651236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:38.655123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:38.660310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1234/2435] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:38.669867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa69-d901-4317-921c-191e9426704c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:38.682041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa69-d901-4317-921c-191e9426704c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:38.687057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:38.687696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.687987 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.688259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.689032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:26:38.689336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:38.690961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:38.703736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1202/2436] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:26:38.708431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:38.718941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f362d6-0328-43bb-9009-60a6132d4ccd None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:38.723781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:38.724506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.724865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.725214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.726002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:38.727993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:38.807451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1235/2437] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:38 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:38.808685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:38.820155 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769ba5-95a6-4f42-afa3-125027005822 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:38.832013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:38.884724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:38.885346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:38.885628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:38.885944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:38.886635 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:38.889437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.003210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1203/2438] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:38 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:39.007208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.018247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ae42-1d46-43f3-bed8-c5e184b6f19a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.022850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.023454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.023733 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.024003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.024691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.026300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.036854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1236/2439] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:39.045321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.055521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6024-d9e1-4468-b90c-2add2555bed5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.060154 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.060812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.061297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.061606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.062369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.063951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189738b6-04d2-4f8c-9c65-60678d25dbbd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.074378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1204/2440] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:39.079795 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.089648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432104f7-759f-467a-87dd-ff0009dd2831 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.094919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.095571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.095856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.096148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] PATH_INFO: `/v3/projects/b25fe53c8f9b4bf9854cf1761027a2c6/users/41777a228a36445cb8bb8f7123337f1b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.110598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25fe53c8f9b4bf9854cf1761027a2c6, user_id=41777a228a36445cb8bb8f7123337f1b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.113226 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.191042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1237/2441] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:39 2022] PUT /identity/v3/projects/b25fe53c8f9b4bf9854cf1761027a2c6/users/41777a228a36445cb8bb8f7123337f1b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:39.204006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.204294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.204572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.233162 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] MFA Rules not processed for user `41777a228a36445cb8bb8f7123337f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:39.234460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:39.298611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1205/2442] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:39.303068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.366677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78d5c-e09b-492f-be7c-f498970f57a9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.371527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.372161 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.372475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.372756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.374044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.375972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.385699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:39.460723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1238/2443] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:39 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:39.464842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.476750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32498268-3729-4aab-a846-93f5369f57a1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.534265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.534888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.535196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.535458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.536128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.538103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.630203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1206/2444] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:39 2022] POST /identity/v3/users => generated 307 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:39.633984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.644806 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff576-c3f1-424c-8c36-51d6395b5e9a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.649371 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.650014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.650298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.650575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.651268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.652864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.663237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1239/2445] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:39.667414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.677989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a551b-c235-4ad3-bf21-deed6f927324 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.682753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.683409 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.683696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.683978 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] PATH_INFO: `/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6/users/217303f0b10a4f9a9b4c470e2bc0c4d5/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.688036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:39.700023 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033739dfeb974a4bbeabc2b0d9d0d9f6, user_id=217303f0b10a4f9a9b4c470e2bc0c4d5, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.703085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.792270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1207/2446] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:39 2022] PUT /identity/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6/users/217303f0b10a4f9a9b4c470e2bc0c4d5/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:39.797260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.807576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03753eb1-efa1-408f-b46c-9e79b75b2715 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.866525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.867172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.867453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.867726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.868412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.870028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6ac61-e2fc-4b23-b0b6-fbf953f5b4ec admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.888865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1240/2447] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:26:39.889068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:39.896545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc9f7-f87b-4074-98b1-5879470c9b11 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:39.901134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:39.901871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.902153 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.902439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] PATH_INFO: `/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6/users/217303f0b10a4f9a9b4c470e2bc0c4d5/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.904371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=033739dfeb974a4bbeabc2b0d9d0d9f6, user_id=217303f0b10a4f9a9b4c470e2bc0c4d5, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:39.907124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:39.917819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1208/2448] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:39 2022] PUT /identity/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6/users/217303f0b10a4f9a9b4c470e2bc0c4d5/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:39.928759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:39.929054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:39.929339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:39.958366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] MFA Rules not processed for user `217303f0b10a4f9a9b4c470e2bc0c4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:39.959597 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:40.038839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1241/2449] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:40.050186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:40.051907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:40.107358 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4b482-03df-48e1-86ac-907b1e812cfe admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:40.111974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:40.112614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.112902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.113185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.122574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:40.124185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806e543-2293-4ad7-9ed5-7a2fbb10c715 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:40.133602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1209/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:40.287157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:40.350554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5cd5-90b5-40a5-ae9e-249f1e7a5c8f None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:40.355274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:40.355916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.356203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.356480 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] PATH_INFO: `/v3/users/41777a228a36445cb8bb8f7123337f1b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.358218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41777a228a36445cb8bb8f7123337f1b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:40.360151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:40.361614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:40.593251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41777a228a36445cb8bb8f7123337f1b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:40.593960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41777a228a36445cb8bb8f7123337f1b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:40.605971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41777a228a36445cb8bb8f7123337f1b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:40.612749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41777a228a36445cb8bb8f7123337f1b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:40.699083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41777a228a36445cb8bb8f7123337f1b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:40.705801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1242/2451] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:40 2022] DELETE /identity/v3/users/41777a228a36445cb8bb8f7123337f1b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:40.710331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.710798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.710909 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.730249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:40.731461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:40.792766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1210/2452] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:40.803757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:40.805238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:40.863637 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f607b-c527-483e-b982-f2e6a98666c8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:40.867627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:40.868246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.868533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.868812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.878469 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:40.886606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:40.889789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1243/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:41.335167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:41.338067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:41.349429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2df1-9246-479d-944c-d7be9ef15adc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:41.354214 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:41.354919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:41.355247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:41.355486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] PATH_INFO: `/v3/projects/b25fe53c8f9b4bf9854cf1761027a2c6` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:41.356649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25fe53c8f9b4bf9854cf1761027a2c6)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:41.359521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:41.493974 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25fe53c8f9b4bf9854cf1761027a2c6', 'request_id': 'req-21a7ad18-b465-477e-bf1a-8102a8a3df6d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.500124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25fe53c8f9b4bf9854cf1761027a2c6', 'request_id': 'req-21a7ad18-b465-477e-bf1a-8102a8a3df6d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.506272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25fe53c8f9b4bf9854cf1761027a2c6', 'request_id': 'req-21a7ad18-b465-477e-bf1a-8102a8a3df6d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.631757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:41.636398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] The token cache is being invalidate because project b25fe53c8f9b4bf9854cf1761027a2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:41.636692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.637312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.639272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1211/2454] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:41 2022] DELETE /identity/v3/projects/b25fe53c8f9b4bf9854cf1761027a2c6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:41.642918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:41.652785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a8bb-32bb-495f-9f97-0481f7d9eadc service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:41.710975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:41.711614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:41.711898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:41.712175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] PATH_INFO: `/v3/users/217303f0b10a4f9a9b4c470e2bc0c4d5` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:41.713359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217303f0b10a4f9a9b4c470e2bc0c4d5)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:41.715322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:41.737471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:41.874395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217303f0b10a4f9a9b4c470e2bc0c4d5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.875069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217303f0b10a4f9a9b4c470e2bc0c4d5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.886941 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217303f0b10a4f9a9b4c470e2bc0c4d5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.894028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217303f0b10a4f9a9b4c470e2bc0c4d5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.956251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e04bac02-a821-4305-82c4-db0daf73d644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217303f0b10a4f9a9b4c470e2bc0c4d5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:41.962508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1244/2455] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:41 2022] DELETE /identity/v3/users/217303f0b10a4f9a9b4c470e2bc0c4d5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:42.386636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:42.389169 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:42.403898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7ad18-b465-477e-bf1a-8102a8a3df6d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:42.466556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:42.467803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:42.468030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:42.468343 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] PATH_INFO: `/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:42.469521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033739dfeb974a4bbeabc2b0d9d0d9f6)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:42.471512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:42.578223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033739dfeb974a4bbeabc2b0d9d0d9f6', 'request_id': 'req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:42.583997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033739dfeb974a4bbeabc2b0d9d0d9f6', 'request_id': 'req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:42.590583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033739dfeb974a4bbeabc2b0d9d0d9f6', 'request_id': 'req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:42.675037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] The token cache is being invalidate because project 033739dfeb974a4bbeabc2b0d9d0d9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:42.675257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:42.675878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1e9283ff-9fe9-4c03-8352-e8d2c6a6ba33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:42.677384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1212/2456] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:42 2022] DELETE /identity/v3/projects/033739dfeb974a4bbeabc2b0d9d0d9f6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:42.682385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:42.682843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:42.682956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:42.703294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:42.704571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:42.768671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1245/2457] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:42.776621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:42.776916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:42.777202 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:42.798229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:42.799462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:42.807599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1213/2458] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:42.813077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:42.822851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88004-44c5-4fb6-bc8e-25371c230b63 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:42.828351 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:42.829040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:42.829392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:42.829784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:42.830561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:26:42.830933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:42.832634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:42.844882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1246/2459] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:26:42.849322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:42.858877 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f6a4-6795-4142-b331-0454ab397334 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:42.863935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:42.864581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:42.864859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:42.865132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:42.865815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:42.867982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:42.954100 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1214/2460] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:42 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:42.957911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:42.968133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6250ac-cc2e-444e-9400-c24021243a4b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.023833 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.024444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.024728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.025001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.025670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.027608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.155174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1247/2461] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:42 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:43.159296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.170406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9f84-210e-48cb-a151-4cff00b53025 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.174973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.175579 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.175860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.176133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.176847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.178592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.188989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1215/2462] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:43.192809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.203062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a312d-7a83-4f5a-9ca2-7726ef84438a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.207752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.208299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.208582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.208856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.209553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.211218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f8b32-2bb6-43ce-bb5a-3fa6a79462b9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.221969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1248/2463] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:43.225931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.236692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe6311-9b25-4139-b7d2-e66f6e06c9dd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.241736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.242429 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.242715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.242994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] PATH_INFO: `/v3/projects/3904b637bedb4a84802023e0f7e1f44a/users/e2ddbcb881924200b3f8f1b4ca055caf/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.257898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3904b637bedb4a84802023e0f7e1f44a, user_id=e2ddbcb881924200b3f8f1b4ca055caf, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.260532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.350852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1216/2464] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:43 2022] PUT /identity/v3/projects/3904b637bedb4a84802023e0f7e1f44a/users/e2ddbcb881924200b3f8f1b4ca055caf/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:43.361988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.362313 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.362595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.377108 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:43.392012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] MFA Rules not processed for user `e2ddbcb881924200b3f8f1b4ca055caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:43.393355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:43.462336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1249/2465] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:43.465004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.494264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:43.530382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6920107-5bd3-4845-8c05-fa66af1b3282 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.535299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.535924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.536210 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.536673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.537783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.539345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.650006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1217/2466] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:43 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:43.653903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.664718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdae7-b746-469c-9fe7-fc71aee8fe16 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.720122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.720794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.720933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.721208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.721915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.723825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.836878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1250/2467] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:43 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:43.841396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.852254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159adc4-e495-4a44-9602-1a2520036a8a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.856941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.858378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.858843 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.859146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.859838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.861416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.872098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1218/2468] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:26:43.877118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:43.890075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ad3e0-a1ac-45ea-9374-a8e7322f5b40 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:43.894840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:43.895516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:43.895804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:43.896087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] PATH_INFO: `/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10/users/e76bc89193414aeaab33318775a27519/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:43.911709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9df7bf2106147f3bcb6ef8f3826fa10, user_id=e76bc89193414aeaab33318775a27519, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:43.914448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:43.997314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1251/2469] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:43 2022] PUT /identity/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10/users/e76bc89193414aeaab33318775a27519/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:44.001899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:44.011970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d4199-9f09-4488-84a0-90852631c770 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:44.068598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:44.069304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.069669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.070194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.071016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:44.072665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa12fdd-cf54-411b-b94a-d7653e05772b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:44.083046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1219/2470] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:44.087345 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:44.098592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d46d2-3d89-4ae6-81e2-92ea6802c9d6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:44.103259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:44.103978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.104205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.104536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] PATH_INFO: `/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10/users/e76bc89193414aeaab33318775a27519/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.106496 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9df7bf2106147f3bcb6ef8f3826fa10, user_id=e76bc89193414aeaab33318775a27519, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:44.110310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:44.122304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1252/2471] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:44 2022] PUT /identity/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10/users/e76bc89193414aeaab33318775a27519/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:44.133504 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.133821 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.134103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.162191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] MFA Rules not processed for user `e76bc89193414aeaab33318775a27519`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:44.163513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:44.233493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1220/2472] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:44.244701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:44.246411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:44.318527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:44.328179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:44.329677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:44.330692 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a074-3a47-4862-a362-8f64b5af765d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:44.338235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:44.341070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.341070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.341070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.351860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:44.353095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:44.353786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:44.374485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1253/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:44.431258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eae73-44f9-4fe9-afc9-c59849d96037 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:44.440234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:44.441022 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.441384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.441729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.443682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:44.456608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:44.458391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:44.469684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1221/2474] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:47.380972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:47.382468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:47.438363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:47.445446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205061-5551-4bcd-ab7e-fa0f012069c8 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:47.449062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:47.449681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:47.449996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:47.450269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:47.452832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:47.505947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e0c76-b834-43ae-b861-57fb32284812 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:47.510827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:47.511543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:47.511824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:47.515455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] PATH_INFO: `/v3/users/e2ddbcb881924200b3f8f1b4ca055caf` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:47.515455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ddbcb881924200b3f8f1b4ca055caf)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:47.515868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:47.521551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:47.523061 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b67d0-e636-4a71-8778-cf1be7d56b05 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:47.533481 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1254/2475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:47.776819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ddbcb881924200b3f8f1b4ca055caf'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:47.777480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ddbcb881924200b3f8f1b4ca055caf'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:47.790508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ddbcb881924200b3f8f1b4ca055caf'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:47.791226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ddbcb881924200b3f8f1b4ca055caf'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:47.848157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ddbcb881924200b3f8f1b4ca055caf'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:47.862677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1222/2476] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:47 2022] DELETE /identity/v3/users/e2ddbcb881924200b3f8f1b4ca055caf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:47.867558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:47.868010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:47.868299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:47.887873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:47.889244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:47.951518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1255/2477] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:47.961318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:47.962795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:47.991951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:48.021947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8d65-94e5-4dda-a8f0-d808655eef8e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:48.025831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:48.026470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:48.026757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:48.027038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:48.037051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:48.038592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:48.049142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1223/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:48.463747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:48.463747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:48.481877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc5c10-e2d7-4ed0-9503-ebff981f0944 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:48.491972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:48.492786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:48.493141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:48.493482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] PATH_INFO: `/v3/projects/3904b637bedb4a84802023e0f7e1f44a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:48.494810 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3904b637bedb4a84802023e0f7e1f44a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:48.497239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:48.630972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:48.641626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3904b637bedb4a84802023e0f7e1f44a', 'request_id': 'req-f33e50b0-6e3a-4129-85f7-0f8da4510a42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:48.648466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3904b637bedb4a84802023e0f7e1f44a', 'request_id': 'req-f33e50b0-6e3a-4129-85f7-0f8da4510a42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:48.653969 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3904b637bedb4a84802023e0f7e1f44a', 'request_id': 'req-f33e50b0-6e3a-4129-85f7-0f8da4510a42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:48.768256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] The token cache is being invalidate because project 3904b637bedb4a84802023e0f7e1f44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:48.768550 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:48.769188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:48.771035 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1256/2479] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:48 2022] DELETE /identity/v3/projects/3904b637bedb4a84802023e0f7e1f44a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:48.774884 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:48.786502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33861f41-eb6d-47ce-9656-bc701e79f280 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:48.844580 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:48.845135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:48.845419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:48.845697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] PATH_INFO: `/v3/users/e76bc89193414aeaab33318775a27519` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:48.846955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76bc89193414aeaab33318775a27519)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:48.848888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:49.136344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76bc89193414aeaab33318775a27519'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.137010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76bc89193414aeaab33318775a27519'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.151108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76bc89193414aeaab33318775a27519'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.152165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76bc89193414aeaab33318775a27519'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.231152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cf55800-777f-43d1-882f-0f4c463d8958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76bc89193414aeaab33318775a27519'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.246793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1224/2480] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:48 2022] DELETE /identity/v3/users/e76bc89193414aeaab33318775a27519 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:49.702434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:49.704314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:49.719136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e50b0-6e3a-4129-85f7-0f8da4510a42 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:49.807270 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:49.808046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:49.808338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:49.808621 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] PATH_INFO: `/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:49.810012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9df7bf2106147f3bcb6ef8f3826fa10)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:49.811978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:49.934479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9df7bf2106147f3bcb6ef8f3826fa10', 'request_id': 'req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.942150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9df7bf2106147f3bcb6ef8f3826fa10', 'request_id': 'req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:49.948896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9df7bf2106147f3bcb6ef8f3826fa10', 'request_id': 'req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:50.049017 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] The token cache is being invalidate because project a9df7bf2106147f3bcb6ef8f3826fa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:50.049382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:50.050178 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc8286a9-70b4-46dd-8a83-e1c2ce618ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:50.051928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1257/2481] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:49 2022] DELETE /identity/v3/projects/a9df7bf2106147f3bcb6ef8f3826fa10 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:50.056856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.057785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.058355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.082584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:50.084452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:50.136790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:50.161584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1225/2482] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:50.169598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.170071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.170681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.191447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:50.195825 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:50.204398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1258/2483] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:50.208865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.219048 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79f106-9150-4198-ab3b-c0dfa7a20061 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.224375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.225122 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.225472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.225880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.226668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:26:50.227042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.228724 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.241870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1226/2484] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:26:50.246109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.256015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576c6cc-09da-44a0-93bc-9da24cc7a75e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.260739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.261355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.261640 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.261955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.262620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.265896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.341804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1259/2485] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:50.345916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.357430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4588948-2830-47f0-b716-b4bb916b0a95 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.425792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.426541 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.426905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.427331 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.428860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.432616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.541332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1227/2486] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:50.542580 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.553836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf4226-3338-4dbc-9bd0-968ad4d7e119 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.559227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.560016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.560404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.561289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.562437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.563877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.574639 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1260/2487] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:50.580025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.590889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd373a7-05e0-4672-91c4-de8fd72d91ff admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.596537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.599920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.599920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.599920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.599920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.600287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e642a5-f277-4f62-83a4-dd91048aa06f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.611577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1228/2488] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:26:50.616144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.628117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362106a3-b0c1-4cac-8ea3-c6ff309cc043 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.632619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.633292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.633574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.633919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] PATH_INFO: `/v3/projects/76538fc1aa5946828e8834dd4c52bf24/users/8fe40987b0ba478d81491ff02b5ca58f/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.647937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:50.651034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76538fc1aa5946828e8834dd4c52bf24, user_id=8fe40987b0ba478d81491ff02b5ca58f, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.653783 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:50.728778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1261/2489] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:50 2022] PUT /identity/v3/projects/76538fc1aa5946828e8834dd4c52bf24/users/8fe40987b0ba478d81491ff02b5ca58f/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:50.741460 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.741773 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.742085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.789396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] MFA Rules not processed for user `8fe40987b0ba478d81491ff02b5ca58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:50.791864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:50.858659 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1229/2490] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:50.863248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:50.931005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24302f-27a3-428f-8ea7-f2eba7126525 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:50.938055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:50.938708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:50.939023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:50.939274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:50.940638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:50.942010 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.065605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1262/2491] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:50 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:51.069572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.080340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392537b1-fa9d-4589-83eb-4c274ea6d05c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.123012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:51.139367 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.139986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.140274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.140551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.141225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.143189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.248837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1230/2492] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:51 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:51.252959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.263453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee47589-0aea-4b7a-ac78-2fdda8d3dc6e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.268280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.268886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.269172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.269449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.270181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.271780 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.283120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1263/2493] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:51.287676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.298183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3e9d-828a-4de0-84f9-5966aba995c4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.302737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.303395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.303678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.303954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] PATH_INFO: `/v3/projects/fd7173eec6d54ffdbd2346f2de774028/users/169a333f18504965add3bfcbf81773eb/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.318715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7173eec6d54ffdbd2346f2de774028, user_id=169a333f18504965add3bfcbf81773eb, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.321368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.372791 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1231/2494] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:51 2022] PUT /identity/v3/projects/fd7173eec6d54ffdbd2346f2de774028/users/169a333f18504965add3bfcbf81773eb/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:51.376792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.386831 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed8e6-3687-4e37-9161-1630160f4dca admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.443008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.443620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.443903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.444177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.444871 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.446541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd5105-329a-4c70-a720-06b2ba87a111 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.456894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1264/2495] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:51.461094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.472065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20884377-b3ec-46ab-a667-62ea597e6454 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.476697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.477352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.477647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.477950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] PATH_INFO: `/v3/projects/fd7173eec6d54ffdbd2346f2de774028/users/169a333f18504965add3bfcbf81773eb/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.479896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7173eec6d54ffdbd2346f2de774028, user_id=169a333f18504965add3bfcbf81773eb, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.482602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.492860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1232/2496] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:51 2022] PUT /identity/v3/projects/fd7173eec6d54ffdbd2346f2de774028/users/169a333f18504965add3bfcbf81773eb/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:51.503275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787164e-7840-4687-8537-1277f388bb8a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.503568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787164e-7840-4687-8537-1277f388bb8a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.503847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787164e-7840-4687-8537-1277f388bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.658111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7787164e-7840-4687-8537-1277f388bb8a None None] MFA Rules not processed for user `169a333f18504965add3bfcbf81773eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:51.659332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7787164e-7840-4687-8537-1277f388bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:51.705547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:51.725974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1265/2497] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:51.737820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.739471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:51.798347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817d797-16eb-4806-884b-c06dd41d45d1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.801928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.802551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.802838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.803114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.812544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.814035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.824136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1233/2498] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:51.871179 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787164e-7840-4687-8537-1277f388bb8a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:51.872553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7787164e-7840-4687-8537-1277f388bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:51.884416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787164e-7840-4687-8537-1277f388bb8a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:51.887975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:51.888658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:51.889088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:51.889391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:51.944940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:51.946339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c16fe-7144-461a-b0fe-7f17f285f9d9 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:51.955191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1266/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:56.594887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:56.656112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56193025-60a1-48d7-b0c9-ec59b7e47c8c service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:56.660728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:56.661361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:56.661643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:56.661953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] PATH_INFO: `/v3/users/8fe40987b0ba478d81491ff02b5ca58f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:56.663108 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe40987b0ba478d81491ff02b5ca58f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:56.665052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:56.849097 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:56.855234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe40987b0ba478d81491ff02b5ca58f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:56.855882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe40987b0ba478d81491ff02b5ca58f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:56.870850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe40987b0ba478d81491ff02b5ca58f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:56.871642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe40987b0ba478d81491ff02b5ca58f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:56.950559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe40987b0ba478d81491ff02b5ca58f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:56.964269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1234/2500] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:56 2022] DELETE /identity/v3/users/8fe40987b0ba478d81491ff02b5ca58f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:56.969086 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:56.969549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:56.969663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:56.988894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:56.990235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:57.048111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1267/2501] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:57.057916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:57.059325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:57.115969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211b18-0124-44b7-8929-f4130bbbb4c1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:57.119725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:57.120350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:57.120636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:57.120916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:57.129874 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:57.131306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:57.141040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1235/2502] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:57.523605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:57.525140 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:57.538699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2c5c-93c4-4436-b6ef-280e1f89be3d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:57.544157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:57.545260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:57.545688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:57.546005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] PATH_INFO: `/v3/projects/76538fc1aa5946828e8834dd4c52bf24` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:57.547433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76538fc1aa5946828e8834dd4c52bf24)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:57.549407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:57.642034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76538fc1aa5946828e8834dd4c52bf24', 'request_id': 'req-2f6a817d-8f54-4f9a-8641-4fcaac117b42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.647951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76538fc1aa5946828e8834dd4c52bf24', 'request_id': 'req-2f6a817d-8f54-4f9a-8641-4fcaac117b42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.653308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76538fc1aa5946828e8834dd4c52bf24', 'request_id': 'req-2f6a817d-8f54-4f9a-8641-4fcaac117b42'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.702071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] The token cache is being invalidate because project 76538fc1aa5946828e8834dd4c52bf24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:57.702360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.702979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.704491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1268/2503] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:57 2022] DELETE /identity/v3/projects/76538fc1aa5946828e8834dd4c52bf24 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:57.708467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:57.718152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00e4c-9a7c-4b9b-baf6-ddeef7581a91 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:57.774286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:57.774926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:57.775212 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:57.775485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] PATH_INFO: `/v3/users/169a333f18504965add3bfcbf81773eb` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:57.776651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169a333f18504965add3bfcbf81773eb)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:57.778595 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:57.933547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169a333f18504965add3bfcbf81773eb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.934295 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169a333f18504965add3bfcbf81773eb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.945604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:57.948011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169a333f18504965add3bfcbf81773eb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:57.948759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169a333f18504965add3bfcbf81773eb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.053261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6a255b9-6dda-4699-af0b-c890b3b4b735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169a333f18504965add3bfcbf81773eb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.066861 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1236/2504] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:26:57 2022] DELETE /identity/v3/users/169a333f18504965add3bfcbf81773eb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:58.466254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:58.468523 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:58.482190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a817d-8f54-4f9a-8641-4fcaac117b42 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:58.487242 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:58.541279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:58.541989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:58.542269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:58.542541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] PATH_INFO: `/v3/projects/fd7173eec6d54ffdbd2346f2de774028` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:58.543699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7173eec6d54ffdbd2346f2de774028)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:58.545625 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:58.693431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7173eec6d54ffdbd2346f2de774028', 'request_id': 'req-b418de5a-0c84-43b6-b494-f18e01b8ddaa'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.699601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7173eec6d54ffdbd2346f2de774028', 'request_id': 'req-b418de5a-0c84-43b6-b494-f18e01b8ddaa'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.706064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7173eec6d54ffdbd2346f2de774028', 'request_id': 'req-b418de5a-0c84-43b6-b494-f18e01b8ddaa'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.767531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] The token cache is being invalidate because project fd7173eec6d54ffdbd2346f2de774028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:26:58.767828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.768441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b418de5a-0c84-43b6-b494-f18e01b8ddaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:26:58.770016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1269/2505] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:26:58 2022] DELETE /identity/v3/projects/fd7173eec6d54ffdbd2346f2de774028 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:26:58.774944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:58.775387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:58.775483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:58.795171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:58.796365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:58.853997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1237/2506] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:58.918877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:58.919256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:58.919724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:58.941133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:58.942355 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:58.951220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1270/2507] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:58.955457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:58.965281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaed63-7a5e-40ab-908c-8e38f1a6dd24 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:58.970007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:58.970614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:58.970915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:58.971189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:58.971876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:26:58.972178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:58.973780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:58.986160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1238/2508] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:26:58.990389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.000491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ee5a9-afca-4737-b862-1f7d391b4cb6 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.005110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.005711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.006021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.006294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.007101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.009068 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.101644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1271/2509] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:58 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:59.105652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.116255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55832d-193e-454f-a608-44d32e9b0e34 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.174147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.174765 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.175050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.175329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.176002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.178130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.272109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1239/2510] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:59 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:59.283451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.293603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846f6b9-c952-4d25-a60c-bf5f8c7aecb7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.298773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.299372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.299651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.299921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.300609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.302211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.313162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1272/2511] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:59.317095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.327506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712a18-061f-46ab-b73e-b954f3e6dc28 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.332156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.332759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.333045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.333326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.334050 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.335630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e7b0b-7d2b-467e-a865-8c24ebf92f21 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.346815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1240/2512] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:59.350874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.361694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106f0e6-cc67-4af6-880f-487ab10aac7b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.366668 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.367362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.367647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.367926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] PATH_INFO: `/v3/projects/190a4cc715514456a14e93943635d66a/users/6e49bbb4567246a7b1e790b3221d9ec4/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.383970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190a4cc715514456a14e93943635d66a, user_id=6e49bbb4567246a7b1e790b3221d9ec4, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.386774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.471248 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1273/2513] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:59 2022] PUT /identity/v3/projects/190a4cc715514456a14e93943635d66a/users/6e49bbb4567246a7b1e790b3221d9ec4/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:26:59.481546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.481873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.482157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.510509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] MFA Rules not processed for user `6e49bbb4567246a7b1e790b3221d9ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:59.511735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:59.544373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:59.576319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1241/2514] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:59.581078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.620138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:59.642263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115934b1-6e54-463c-b4fe-3d69a9e73a39 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.646938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.647547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.647830 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.648106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.648761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.650694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.746329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1274/2515] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:26:59 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:26:59.750824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.762933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dd0d3-3bc7-4d16-b7af-81780fb995c9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.821126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.821778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.822067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.822345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.823045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.824919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.899614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1242/2516] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:26:59 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:26:59.903758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.915491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04316-9c3a-44eb-b4f6-a52ace28f04f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.920073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.920809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.920996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.921271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.921997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.923648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.933676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1275/2517] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:59.940178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.950747 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45123c8a-8474-4fee-a413-4346fe54fbd6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.956176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.956887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.957172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.957450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:59.958178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:59.959775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f33315-ce8f-46a9-a13d-e682f8b0cc6a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:59.970717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1243/2518] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:26:59.975069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:59.984930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53451-1e15-4bfa-ab6c-cb5837cbb6d8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:59.989663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:59.990343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:59.990627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:59.991167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] PATH_INFO: `/v3/projects/2e891eaa83d94bd58e4467e9d69f4223/users/e10aaddc74f9491dbf3d188d92cdd69f/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.005608 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e891eaa83d94bd58e4467e9d69f4223, user_id=e10aaddc74f9491dbf3d188d92cdd69f, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.008615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.099366 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1276/2519] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:26:59 2022] PUT /identity/v3/projects/2e891eaa83d94bd58e4467e9d69f4223/users/e10aaddc74f9491dbf3d188d92cdd69f/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:27:00.109932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.110254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.110539 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.139426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] MFA Rules not processed for user `e10aaddc74f9491dbf3d188d92cdd69f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:00.140732 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:00.204199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1244/2520] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:00.208548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.268186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8441-4349-46d8-a0f5-d679546cdcdd admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.272716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.274512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.274512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.274512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.274512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.276393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.406005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1277/2521] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:00 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:00.407461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.418985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cface8-2172-4705-94db-7a9f5b842401 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.460649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:00.477387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.478041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.478327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.478637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.479288 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.481314 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.584793 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1245/2522] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:00 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:00.588766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.599210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c5e1-3278-4ebc-96ae-ea0b5e47385e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.603778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.604380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.604658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.604928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.605610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.607223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.618463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1278/2523] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:00.622625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.633542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a21a-4ba3-4fc2-9c4d-2a766c7f6a98 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.638141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.638824 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.639219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.639506 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] PATH_INFO: `/v3/projects/7362e894714c404f8e3d20bd8436f3df/users/faccf9b887d54650a59cdf02ca3a5186/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.655170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7362e894714c404f8e3d20bd8436f3df, user_id=faccf9b887d54650a59cdf02ca3a5186, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.657839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.755262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1246/2524] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:00 2022] PUT /identity/v3/projects/7362e894714c404f8e3d20bd8436f3df/users/faccf9b887d54650a59cdf02ca3a5186/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:00.759247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.769372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6e63-01dd-4387-9f79-3af63943255d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.825121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.825741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.826058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.826434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.827228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.828816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac4dfa-ff6e-4bd9-ac73-fcbb13d25c3b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.830040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:00.838849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1279/2525] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:00.843801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.854066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc17eb-89c0-42ad-aea0-5bdc07a779e4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:00.859234 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:00.859898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.860183 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.860464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] PATH_INFO: `/v3/projects/7362e894714c404f8e3d20bd8436f3df/users/faccf9b887d54650a59cdf02ca3a5186/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.862454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7362e894714c404f8e3d20bd8436f3df, user_id=faccf9b887d54650a59cdf02ca3a5186, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:00.865080 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:00.875620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1247/2526] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:00 2022] PUT /identity/v3/projects/7362e894714c404f8e3d20bd8436f3df/users/faccf9b887d54650a59cdf02ca3a5186/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:00.887097 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.887406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.887673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.915864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] MFA Rules not processed for user `faccf9b887d54650a59cdf02ca3a5186`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:00.917074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:00.984696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1280/2527] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:00.995908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:00.997571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:01.053941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd336b95-3e0d-4fb9-a8fc-fc12fea1b39a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:01.057485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:01.058122 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:01.058404 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:01.058678 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:01.067519 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:01.068930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:01.078691 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1248/2528] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:01.192859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:01.194322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:01.206869 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e5d3-b3cf-4129-bb9f-24c1404db94a None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:01.210541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:01.211177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:01.211463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:01.211747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:01.268298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:01.269725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82887f-052d-4e35-8335-0574ec6e1190 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:01.278687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1281/2529] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:05.311220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:05.377488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88cbe-0e57-4a69-b0da-dfc0ea043df4 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:05.382036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:05.382702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:05.382986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:05.383264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] PATH_INFO: `/v3/users/6e49bbb4567246a7b1e790b3221d9ec4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:05.384411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e49bbb4567246a7b1e790b3221d9ec4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:05.386393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:05.655510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:05.661636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e49bbb4567246a7b1e790b3221d9ec4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:05.662434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e49bbb4567246a7b1e790b3221d9ec4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:05.674887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e49bbb4567246a7b1e790b3221d9ec4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:05.675528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e49bbb4567246a7b1e790b3221d9ec4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:05.757353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:05.757873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:05.757974 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:05.763184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a1626717-a3bf-4509-96af-6e2442cdf9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e49bbb4567246a7b1e790b3221d9ec4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:05.778354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:05.779947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1249/2530] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:05 2022] DELETE /identity/v3/users/6e49bbb4567246a7b1e790b3221d9ec4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:05.780095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:05.784260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:05.784735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:05.785095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:05.805464 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:05.806848 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:05.838328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1282/2531] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:05.869456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1250/2532] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:05.880098 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:05.881491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:05.910138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:05.939258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a13e-fab1-446f-9e8d-75b86a1c5ed0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:05.942805 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:05.943422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:05.943696 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:05.943965 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:05.953121 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:05.954671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:05.964237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1283/2533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:06.023514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:06.025041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:06.095963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a66d7a-b32e-43a2-9991-cc88dc04c431 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:06.101115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:06.101737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:06.102047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:06.102324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:06.111513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:06.114717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:06.121465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1251/2534] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:27:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:06.399192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:06.400931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:06.424495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb7f56-d4b3-4f26-9c88-1d033c3820b6 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:06.445357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:06.446993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:06.447385 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:06.447770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] PATH_INFO: `/v3/projects/190a4cc715514456a14e93943635d66a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:06.449679 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190a4cc715514456a14e93943635d66a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:06.453325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:06.605777 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190a4cc715514456a14e93943635d66a', 'request_id': 'req-5b942275-3bc4-4512-a11d-cab50ad43f96'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:06.613708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190a4cc715514456a14e93943635d66a', 'request_id': 'req-5b942275-3bc4-4512-a11d-cab50ad43f96'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:06.624920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190a4cc715514456a14e93943635d66a', 'request_id': 'req-5b942275-3bc4-4512-a11d-cab50ad43f96'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:06.698975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] The token cache is being invalidate because project 190a4cc715514456a14e93943635d66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:06.699409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:06.700174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:06.706154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1284/2535] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:06 2022] DELETE /identity/v3/projects/190a4cc715514456a14e93943635d66a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:06.719120 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:06.731985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d102ed8-002c-403c-b2a4-b0dee44ad73c service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:06.784036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:06.799950 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:06.800772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:06.801124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:06.801474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] PATH_INFO: `/v3/users/e10aaddc74f9491dbf3d188d92cdd69f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:06.802770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10aaddc74f9491dbf3d188d92cdd69f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:06.804693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:07.005604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10aaddc74f9491dbf3d188d92cdd69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.006373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10aaddc74f9491dbf3d188d92cdd69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.019893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10aaddc74f9491dbf3d188d92cdd69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.022463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10aaddc74f9491dbf3d188d92cdd69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.120764 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10aaddc74f9491dbf3d188d92cdd69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.139245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1252/2536] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:06 2022] DELETE /identity/v3/users/e10aaddc74f9491dbf3d188d92cdd69f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:27:07.619091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:07.620666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:07.640565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942275-3bc4-4512-a11d-cab50ad43f96 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:07.723326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:07.724657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:07.725036 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:07.725409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] PATH_INFO: `/v3/projects/2e891eaa83d94bd58e4467e9d69f4223` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:07.726978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e891eaa83d94bd58e4467e9d69f4223)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:07.729441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:07.851227 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e891eaa83d94bd58e4467e9d69f4223', 'request_id': 'req-875d2e1e-8cf2-4832-b9e8-d83101fa951c'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.856112 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:07.862526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e891eaa83d94bd58e4467e9d69f4223', 'request_id': 'req-875d2e1e-8cf2-4832-b9e8-d83101fa951c'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.869124 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e891eaa83d94bd58e4467e9d69f4223', 'request_id': 'req-875d2e1e-8cf2-4832-b9e8-d83101fa951c'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.919422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] The token cache is being invalidate because project 2e891eaa83d94bd58e4467e9d69f4223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:07.920139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.925264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:07.927432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1285/2537] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:07 2022] DELETE /identity/v3/projects/2e891eaa83d94bd58e4467e9d69f4223 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:07.931623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:07.934130 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:07.950102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983aff4-b4c8-4534-a815-5cae7150ab4a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:08.023549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:08.024690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:08.025076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:08.025456 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] PATH_INFO: `/v3/users/faccf9b887d54650a59cdf02ca3a5186` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:08.026864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faccf9b887d54650a59cdf02ca3a5186)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:08.029897 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:08.180293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faccf9b887d54650a59cdf02ca3a5186'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:08.181110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faccf9b887d54650a59cdf02ca3a5186'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:08.196954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faccf9b887d54650a59cdf02ca3a5186'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:08.197912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faccf9b887d54650a59cdf02ca3a5186'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:08.201893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:08.281951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c7b3d0c5-1303-473e-aec9-32929c9e7450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faccf9b887d54650a59cdf02ca3a5186'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:08.308268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1253/2538] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:07 2022] DELETE /identity/v3/users/faccf9b887d54650a59cdf02ca3a5186 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:08.792930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:08.795102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:08.831593 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2e1e-8cf2-4832-b9e8-d83101fa951c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:08.952872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:08.953544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:08.953865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:08.954149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] PATH_INFO: `/v3/projects/7362e894714c404f8e3d20bd8436f3df` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:08.959626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7362e894714c404f8e3d20bd8436f3df)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:08.961785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:09.066294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7362e894714c404f8e3d20bd8436f3df', 'request_id': 'req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:09.072867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7362e894714c404f8e3d20bd8436f3df', 'request_id': 'req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:09.079694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7362e894714c404f8e3d20bd8436f3df', 'request_id': 'req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:09.172312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] The token cache is being invalidate because project 7362e894714c404f8e3d20bd8436f3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:09.172609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:09.173277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-6df9f4a9-ebde-4618-a444-12b0fbd4ca46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:09.174855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1286/2539] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:08 2022] DELETE /identity/v3/projects/7362e894714c404f8e3d20bd8436f3df => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:09.181298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a77591-7d99-404e-9124-445409411d44 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:09.181938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a77591-7d99-404e-9124-445409411d44 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:09.181938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a77591-7d99-404e-9124-445409411d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:09.202959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f5a77591-7d99-404e-9124-445409411d44 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:09.204231 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f5a77591-7d99-404e-9124-445409411d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:09.267065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1254/2540] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:09.275459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:09.275746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:09.276041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:09.298511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:09.299882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:09.307918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1287/2541] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:09.312704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a77591-7d99-404e-9124-445409411d44 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:09.322822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a77591-7d99-404e-9124-445409411d44 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:09.327564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:09.328171 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:09.328450 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:09.328721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:09.329408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:27:09.329708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:09.331322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:09.343284 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1255/2542] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:27:09.348052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:09.359034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526d66-1dc4-45d4-bb45-0b8d889ae855 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:09.363866 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:09.364478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:09.364759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:09.365033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:09.366040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:09.367940 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:09.785725 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1288/2543] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:09 2022] POST /identity/v3/projects => generated 385 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:09.790192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:09.800468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285aa67-dcd2-4e1d-bb8e-fd85845efc8a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:09.876499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:09.877124 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:09.877405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:09.877686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:09.878439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:09.880534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:09.973615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1256/2544] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:09 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:27:09.977711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:10.005548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4019-fe32-46bb-b91c-4d2e4009eaad admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:10.012144 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:10.014383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:10.014694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:10.014991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:10.020085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:10.024130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:10.039499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1289/2545] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:27:10.043112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:10.058368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b83d-7f6c-483c-90e4-0032cbe45d23 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:10.064039 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:10.067119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:10.067119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:10.067119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:10.067119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:10.068142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df585df-9f0f-4a8c-8c97-99cc7378664b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:10.082975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1257/2546] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:10.086155 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:10.102576 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e41a1-49ee-4b78-bd0e-b16e09c4a923 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:10.110575 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:10.111421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:10.111803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:10.112252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] PATH_INFO: `/v3/projects/bd1f3296cb334e4bac7d3944390499cb/users/c608f5614767416fb0ca2e8c3aaa00d0/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:10.132687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1f3296cb334e4bac7d3944390499cb, user_id=c608f5614767416fb0ca2e8c3aaa00d0, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:10.135812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:10.214271 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1290/2547] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:10 2022] PUT /identity/v3/projects/bd1f3296cb334e4bac7d3944390499cb/users/c608f5614767416fb0ca2e8c3aaa00d0/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:10.227243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:10.227762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:10.227885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:10.260093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] MFA Rules not processed for user `c608f5614767416fb0ca2e8c3aaa00d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:10.261486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:10.311957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:10.346388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1258/2548] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:10.354989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:10.356881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:10.369300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:10.435370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4543b4-e527-4748-82d5-0bb767ca56f6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:10.442629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:10.442629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:10.442629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:10.442629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:10.455047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:10.456772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a56c1-0f9c-4e6b-8670-826ddb390a42 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:10.471761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1291/2549] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:20.488721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:20.514821 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=23 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:20.959838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:21.024317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcca95-6c49-454f-bb32-4be360efc65c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:21.028748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:21.029436 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:21.029727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:21.030035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] PATH_INFO: `/v3/users/c608f5614767416fb0ca2e8c3aaa00d0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:21.031208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c608f5614767416fb0ca2e8c3aaa00d0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:21.033931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:21.256535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c608f5614767416fb0ca2e8c3aaa00d0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:21.257259 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c608f5614767416fb0ca2e8c3aaa00d0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:21.269733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c608f5614767416fb0ca2e8c3aaa00d0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:21.277905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c608f5614767416fb0ca2e8c3aaa00d0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:21.354681 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c608f5614767416fb0ca2e8c3aaa00d0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:21.368219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1259/2550] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:20 2022] DELETE /identity/v3/users/c608f5614767416fb0ca2e8c3aaa00d0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:21.372847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:21.373137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:21.373416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:21.393237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:21.394503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:21.458962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1292/2551] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:21.468820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:21.472889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:21.531455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76cbc-04ce-4f52-b5eb-8581621463a4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:21.534995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:21.535616 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:21.535900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:21.536174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:21.545459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:21.546998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8133fb-0576-44d7-922f-5a8973174315 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:21.557077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1260/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:22.043252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.045138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:22.061369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a41d0-2ec0-476c-886a-cbf33ca90df1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.067223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.068032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.068497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.068958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] PATH_INFO: `/v3/projects/bd1f3296cb334e4bac7d3944390499cb` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.070879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1f3296cb334e4bac7d3944390499cb)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.074280 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.171072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1f3296cb334e4bac7d3944390499cb', 'request_id': 'req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:22.177683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1f3296cb334e4bac7d3944390499cb', 'request_id': 'req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:22.183127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1f3296cb334e4bac7d3944390499cb', 'request_id': 'req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:22.246794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] The token cache is being invalidate because project bd1f3296cb334e4bac7d3944390499cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:22.247085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:22.247811 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b7aafa7b-ba73-429b-a173-3eb6630cd2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:22.249316 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1293/2553] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:22 2022] DELETE /identity/v3/projects/bd1f3296cb334e4bac7d3944390499cb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:22.255149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.255447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.255755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.275035 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:22.276351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:22.294149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:22.338702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1261/2554] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:22.346685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.346983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.347249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.369601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:22.370946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:22.381428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1294/2555] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:22.385629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.399647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd4fa0-8476-429f-b87f-c0403b950344 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.404989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.406562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.406562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.406562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.407083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:27:22.407324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.408932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.421610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1262/2556] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:27:22.426766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.436291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f324c-3fae-4786-a6e4-7eb7a87512f3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.445201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.445201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.445201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.445201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.445979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.445979 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.603709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1295/2557] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:22.607794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.619161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff94c6-385f-4b66-a766-820990ab0de4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.675266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.675883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.676167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.676446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.677131 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.679094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.755307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1263/2558] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:22.759462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.772186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace10-6451-47ae-9543-8df412beab02 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.776789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.777398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.777712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.778028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.778731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.780323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.793634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1296/2559] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:22.795969 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.806682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d809c0-3884-42af-8146-44d4e8b68440 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.811564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.815999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.815999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.815999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.815999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.815999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf9d7-4908-4bcf-9f4b-5649bc8fa7cd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.828110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1264/2560] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:22.833089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.844675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f156a3-ce42-4943-8d8c-aa78cf07601f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:22.847666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:22.848325 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.848604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.848876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] PATH_INFO: `/v3/projects/ac47bf0a776340cfb2956cc7a253b8c2/users/e1cd4aeffeb3425b930c0aa46b25c3fd/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.864943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac47bf0a776340cfb2956cc7a253b8c2, user_id=e1cd4aeffeb3425b930c0aa46b25c3fd, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:22.867956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:22.939224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1297/2561] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:22 2022] PUT /identity/v3/projects/ac47bf0a776340cfb2956cc7a253b8c2/users/e1cd4aeffeb3425b930c0aa46b25c3fd/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:22.949571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.949908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.950193 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.978788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] MFA Rules not processed for user `e1cd4aeffeb3425b930c0aa46b25c3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:22.980025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:23.045098 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1265/2562] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:23.050540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.072073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:23.111757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddfef9-e992-4f73-93df-55184966d4ef admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.116886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.117499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.117800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.124186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.124186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.124186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.223818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1298/2563] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:23.224992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.236301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f332ef5-f5ba-421a-8fe9-c909fa1732ad None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.248934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:23.293664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.294315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.294600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.294875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.295639 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.298324 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.412078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1266/2564] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:23.416294 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.427443 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686c3b7-62a4-4d77-9b14-2149c6fd3451 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.431978 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.432581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.432861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.433131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.433854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.435466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.445993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1299/2565] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:27:23.449887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.460189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fc1d3-7261-407e-a97c-8db41f6b0122 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.464929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.465535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.465851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.466147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.466816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.468406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318f66-db33-4cdb-954e-a7325fc3a884 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.479051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1267/2566] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:23.483150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.494303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa658a8-e687-4efb-a091-15533f792360 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.498842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.499495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.499785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.500110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] PATH_INFO: `/v3/projects/4898becf80c74dc9a52ea95ca032ba06/users/651e25f40e6e44b0901fc1c6cc673075/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.514689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4898becf80c74dc9a52ea95ca032ba06, user_id=651e25f40e6e44b0901fc1c6cc673075, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.517583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.624215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1300/2567] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:23 2022] PUT /identity/v3/projects/4898becf80c74dc9a52ea95ca032ba06/users/651e25f40e6e44b0901fc1c6cc673075/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:23.635610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd19f-22d9-4e1b-8e48-82c019c1ff40 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.636107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd19f-22d9-4e1b-8e48-82c019c1ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.636227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd19f-22d9-4e1b-8e48-82c019c1ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.668615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d93dd19f-22d9-4e1b-8e48-82c019c1ff40 None None] MFA Rules not processed for user `651e25f40e6e44b0901fc1c6cc673075`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:23.669738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d93dd19f-22d9-4e1b-8e48-82c019c1ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:23.742576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1268/2568] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:23.747066 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.750313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d65d0-e4ce-406e-a297-f2668b64edfa None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.750313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d65d0-e4ce-406e-a297-f2668b64edfa None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.750313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d65d0-e4ce-406e-a297-f2668b64edfa None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.750637 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1269/2569] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:27:23.757383 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.757660 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.758045 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.779272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:23.780488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:23.844939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b3e77-86ad-4ba9-ae04-4809636dfc9e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.850612 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.851314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.851736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.852048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.852782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.855094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.859126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1270/2570] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:23.876665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.878351 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:23.899055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:23.933132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1301/2571] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:23.933775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:23.937871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441658-1e3d-466b-8cac-3028e9d6b75a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.988640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.989269 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.989556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.989863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.993009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:23.997607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ff158-cbe8-4644-87f7-bfb9678e020a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.002836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.003451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.003723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.003995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.004784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.006766 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.059452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.061008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.073971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1302/2572] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:23 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:24.074494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1271/2573] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:27:24.075047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.085841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b7e71-47ca-4202-9620-c651baeb4f19 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.090470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.091102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.091372 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.091776 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.092503 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.094183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.108218 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1303/2574] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:27:24.109512 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.120453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce5d7-28e8-4626-a337-e3956e26795c service glance] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.125081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.126468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.129041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.129041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] PATH_INFO: `/v3/projects/17e04c5956a74d15a55d72a52664050a/users/963dc0710b52412a914b4ab49ac5e7b8/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.142589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e04c5956a74d15a55d72a52664050a, user_id=963dc0710b52412a914b4ab49ac5e7b8, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.145264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fbbc1-ad57-466d-b10c-2bd26e2f7dc7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.252209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1272/2575] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:24 2022] PUT /identity/v3/projects/17e04c5956a74d15a55d72a52664050a/users/963dc0710b52412a914b4ab49ac5e7b8/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:24.256150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.266137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa9ec-909e-4322-9b80-40f932400471 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.281330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db4f1d-44b4-473f-aaa8-f7d8c10950ec None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.281622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db4f1d-44b4-473f-aaa8-f7d8c10950ec None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.281981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db4f1d-44b4-473f-aaa8-f7d8c10950ec None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.283281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1273/2576] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:27:24.287648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.287929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.305717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.308564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] MFA Rules not processed for user `736ade5de27a48319e720a6f968c0239`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:24.309801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.323421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.324041 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.324324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.324595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.325287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.327008 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.338502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1304/2577] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:27:24.342505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.353463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88939f9a-aed9-4727-af3b-8fbba7a04b9d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.357225 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:24.358190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.358850 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.359138 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.359449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] PATH_INFO: `/v3/projects/17e04c5956a74d15a55d72a52664050a/users/963dc0710b52412a914b4ab49ac5e7b8/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.362142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e04c5956a74d15a55d72a52664050a, user_id=963dc0710b52412a914b4ab49ac5e7b8, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.364560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1274/2578] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:24.364808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3ecc-e05c-48be-8164-0963c3f7ec00 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.384617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1305/2579] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:24 2022] PUT /identity/v3/projects/17e04c5956a74d15a55d72a52664050a/users/963dc0710b52412a914b4ab49ac5e7b8/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:27:24.385996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.385996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.390030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ca1da-b869-4952-86e7-89c0be51cf82 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.390181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dcf5-6070-43c4-8e0d-b4a037af283f None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.390651 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dcf5-6070-43c4-8e0d-b4a037af283f None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.391255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3dcf5-6070-43c4-8e0d-b4a037af283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.420454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-93b3dcf5-6070-43c4-8e0d-b4a037af283f None None] MFA Rules not processed for user `963dc0710b52412a914b4ab49ac5e7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:24.421680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-93b3dcf5-6070-43c4-8e0d-b4a037af283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.442564 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.443289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.443469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.443807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.451428 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.452868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.461146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1275/2580] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:24.496353 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1306/2581] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:24.509578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.511095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.551993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e71-3a19-4566-bcbd-4a90d5ac804c None None] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.552282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e71-3a19-4566-bcbd-4a90d5ac804c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.552555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd237e71-3a19-4566-bcbd-4a90d5ac804c None None] PATH_INFO: `/` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.554009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1307/2582] 10.222.0.49 () {54 vars in 921 bytes} [Mon Aug 1 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:27:24.559402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.559752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.560095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.571076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ce58-4af6-48ad-8a27-3eb0f03bed58 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.574949 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.575576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.575859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.576141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.580040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] MFA Rules not processed for user `4b73ce0aeb0846d88bf3e4b21405eda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:24.581230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.621681 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:24.633858 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.635527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.644740 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1276/2583] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:24.650649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1308/2584] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Aug 1 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:24.662223 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:24.663743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:24.676981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24de77-7b03-4ade-bed3-a17e2f8cadaf service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:24.680775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:24.681389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:24.681669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:24.681981 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:24.693385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:24.694846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:24.706057 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1277/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:27:26.700471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:26.710027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b90ae6-e7aa-43f2-abf0-d0e51120d752 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:26.713554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:26.714205 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:26.714487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:26.714760 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:26.772172 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:26.773620 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71135b-aba9-4d38-a004-36c36df47ccb service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:26.782824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1309/2586] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:28.250058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:28.260256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe957ca-feb0-48ee-a52a-740586d73bdd service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:28.264025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:28.264633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:28.264918 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:28.265232 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:28.276002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:28.277461 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:28.287578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1278/2587] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:28.459229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:28.460349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:28.460629 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:28.487148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:28.488369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:28.559091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1310/2588] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:28.571831 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:28.573321 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:28.610425 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:28.646910 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a87e7-6ac2-4d35-9f0e-8c5d3be28213 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:28.651973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:28.652605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:28.652880 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:28.653157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:28.662002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:28.667483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2bf96-b332-467f-99a7-5e9637c144ea service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:28.671573 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1279/2589] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:27:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:32.985722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:33.055412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0cc70-ee9e-4b07-a78a-2e521422af53 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:33.060346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:33.061055 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:33.061407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:33.061740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] PATH_INFO: `/v3/users/e1cd4aeffeb3425b930c0aa46b25c3fd` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:33.063746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cd4aeffeb3425b930c0aa46b25c3fd)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:33.065838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:33.090439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:33.306285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cd4aeffeb3425b930c0aa46b25c3fd'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:33.306945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cd4aeffeb3425b930c0aa46b25c3fd'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:33.339548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cd4aeffeb3425b930c0aa46b25c3fd'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:33.348916 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cd4aeffeb3425b930c0aa46b25c3fd'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:33.418685 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cd4aeffeb3425b930c0aa46b25c3fd'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:33.427311 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1311/2590] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:32 2022] DELETE /identity/v3/users/e1cd4aeffeb3425b930c0aa46b25c3fd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:33.432038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:33.432571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:33.432673 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:33.481707 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:33.483008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:33.549623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1280/2591] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:33.559478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:33.560961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:33.626746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641cdf-6d97-451c-b3f9-92086565d917 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:33.630493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:33.631130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:33.631421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:33.631702 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:33.643210 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:33.644840 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:33.657694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1312/2592] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:34.102252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:34.102519 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:34.116873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523fb7-17a8-4350-ac19-af473e6e7bc5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:34.121667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:34.122391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:34.134407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:34.139011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] PATH_INFO: `/v3/projects/ac47bf0a776340cfb2956cc7a253b8c2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:34.139011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac47bf0a776340cfb2956cc7a253b8c2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:34.139011 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:34.273359 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac47bf0a776340cfb2956cc7a253b8c2', 'request_id': 'req-854cad38-be3c-4c30-a2f2-6e333baebf61'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.280441 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac47bf0a776340cfb2956cc7a253b8c2', 'request_id': 'req-854cad38-be3c-4c30-a2f2-6e333baebf61'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.288325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac47bf0a776340cfb2956cc7a253b8c2', 'request_id': 'req-854cad38-be3c-4c30-a2f2-6e333baebf61'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.366226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] The token cache is being invalidate because project ac47bf0a776340cfb2956cc7a253b8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:34.366449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.367040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.368755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1281/2593] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:34 2022] DELETE /identity/v3/projects/ac47bf0a776340cfb2956cc7a253b8c2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:34.372880 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:34.383120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a1467-c4fe-44d6-b707-a8a2f9b4523a service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:34.451245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:34.451894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:34.452329 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:34.452633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] PATH_INFO: `/v3/users/651e25f40e6e44b0901fc1c6cc673075` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:34.454610 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651e25f40e6e44b0901fc1c6cc673075)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:34.456566 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:34.670312 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:34.677284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651e25f40e6e44b0901fc1c6cc673075'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.678235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651e25f40e6e44b0901fc1c6cc673075'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.695536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651e25f40e6e44b0901fc1c6cc673075'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.703070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651e25f40e6e44b0901fc1c6cc673075'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.777261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651e25f40e6e44b0901fc1c6cc673075'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:34.787551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1313/2594] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:34 2022] DELETE /identity/v3/users/651e25f40e6e44b0901fc1c6cc673075 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:36.140999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:36.142766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:36.159806 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad38-be3c-4c30-a2f2-6e333baebf61 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:36.213090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:36.229261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:36.229984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:36.230268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:36.230549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] PATH_INFO: `/v3/projects/4898becf80c74dc9a52ea95ca032ba06` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:36.231737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4898becf80c74dc9a52ea95ca032ba06)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:36.233665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:36.350152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4898becf80c74dc9a52ea95ca032ba06', 'request_id': 'req-a8a45032-2212-407f-9aa7-522878ee7a75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.359387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4898becf80c74dc9a52ea95ca032ba06', 'request_id': 'req-a8a45032-2212-407f-9aa7-522878ee7a75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.371528 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4898becf80c74dc9a52ea95ca032ba06', 'request_id': 'req-a8a45032-2212-407f-9aa7-522878ee7a75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.479211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] The token cache is being invalidate because project 4898becf80c74dc9a52ea95ca032ba06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:36.479437 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.480268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.481807 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1282/2595] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:36 2022] DELETE /identity/v3/projects/4898becf80c74dc9a52ea95ca032ba06 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:36.486513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:36.488310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:36.502411 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f2182-07ae-4732-87ad-ba4f57333327 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:36.563352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:36.563900 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:36.564185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:36.564459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] PATH_INFO: `/v3/users/963dc0710b52412a914b4ab49ac5e7b8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:36.565808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963dc0710b52412a914b4ab49ac5e7b8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:36.567741 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:36.748952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963dc0710b52412a914b4ab49ac5e7b8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.749531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963dc0710b52412a914b4ab49ac5e7b8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.761514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963dc0710b52412a914b4ab49ac5e7b8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.768452 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963dc0710b52412a914b4ab49ac5e7b8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.858519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b5d14178-0a63-477f-a3dc-03df90d81ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963dc0710b52412a914b4ab49ac5e7b8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:36.865988 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1314/2596] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:36 2022] DELETE /identity/v3/users/963dc0710b52412a914b4ab49ac5e7b8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:37.346524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:37.348249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:37.362286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a45032-2212-407f-9aa7-522878ee7a75 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:37.429721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:37.430412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.430757 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.431083 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] PATH_INFO: `/v3/projects/17e04c5956a74d15a55d72a52664050a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.432274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e04c5956a74d15a55d72a52664050a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:37.434340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:37.541986 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e04c5956a74d15a55d72a52664050a', 'request_id': 'req-eb997c9e-249d-48f2-87e9-9deec4fb0102'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:37.547701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e04c5956a74d15a55d72a52664050a', 'request_id': 'req-eb997c9e-249d-48f2-87e9-9deec4fb0102'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:37.553785 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e04c5956a74d15a55d72a52664050a', 'request_id': 'req-eb997c9e-249d-48f2-87e9-9deec4fb0102'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:37.621887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] The token cache is being invalidate because project 17e04c5956a74d15a55d72a52664050a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:37.622111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:37.622733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb997c9e-249d-48f2-87e9-9deec4fb0102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:37.624462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1283/2597] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:37 2022] DELETE /identity/v3/projects/17e04c5956a74d15a55d72a52664050a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:37.630257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.630757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.630889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.651145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:37.658104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:37.684938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:37.711365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1315/2598] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:37.720434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.720719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.721096 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.729605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:37.741431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:37.742920 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:37.751287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1284/2599] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:37.758220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:37.768551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89bf8b-7809-4011-8cc9-75db55fa03fa None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:37.773934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:37.774551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.774836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.775113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.775961 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:27:37.776279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:37.778005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:37.792051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1316/2600] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:27:37.796299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:37.806646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d047c-457e-448a-8c59-a1b5cdd30ab4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:37.811246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:37.811849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.812127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.812400 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.813132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:37.815059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:37.895148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1285/2601] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:37 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:27:37.899404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:37.912688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6120b3-077c-4b24-942b-3f3e32c27807 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:37.973213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:37.973875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:37.974165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:37.974446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:37.975127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:37.977043 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:38.099195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1317/2602] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:37 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:38.103255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:38.113725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea507bce-4dee-4dbd-ba6d-88721456ec26 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:38.118577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:38.119192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:38.119477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:38.119759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:38.120458 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:38.122147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:38.132672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1286/2603] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:38.136613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:38.148477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eaf4b-7357-4c3f-b8f9-280d7acf46d6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:38.153082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:38.153724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:38.154542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:38.154542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:38.155026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:38.156609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ad41-25f6-4ae5-ade0-e7325c7f243d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:38.168120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1318/2604] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:38.172280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:38.182925 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc812e92-78a1-42fb-84e9-e6bdadcc6682 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:38.187647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:38.188382 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:38.189278 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:38.189912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] PATH_INFO: `/v3/projects/1d34ed67668c475695dbd57530aa6d49/users/cc8d9f649a43450da28c0f7c2e4515ec/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:38.206165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d34ed67668c475695dbd57530aa6d49, user_id=cc8d9f649a43450da28c0f7c2e4515ec, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:38.208820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:38.276420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1287/2605] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:38 2022] PUT /identity/v3/projects/1d34ed67668c475695dbd57530aa6d49/users/cc8d9f649a43450da28c0f7c2e4515ec/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:38.281277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22575eb8-ea59-44e9-a286-3c63ff62fab5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:38.281568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22575eb8-ea59-44e9-a286-3c63ff62fab5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:38.281881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22575eb8-ea59-44e9-a286-3c63ff62fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:38.301253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-22575eb8-ea59-44e9-a286-3c63ff62fab5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:38.302510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-22575eb8-ea59-44e9-a286-3c63ff62fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:38.366441 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1319/2606] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:38.376748 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:38.378612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:38.439970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aa845-9411-4c85-a786-ad868c8a9f1d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:38.443863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:38.445676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:38.445676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:38.445676 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:38.456944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:38.458549 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:38.473992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1288/2607] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:44.448440 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:44.448878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:44.448985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:44.493279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] MFA Rules not processed for user `cc8d9f649a43450da28c0f7c2e4515ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:44.494815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:44.549192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:44.578943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1320/2608] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:44.583548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:44.601624 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56718d-4299-4a4b-8077-ea0a272e915d service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:44.615818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:44.616529 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:44.616867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:44.617251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:44.618218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:44.624554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:44.734682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1289/2609] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:44 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:27:44.739513 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:44.752763 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df56e-b87b-43a9-ab75-38b6cc3ee084 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:44.832986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:44.834085 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:44.834546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:44.834999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:44.835859 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:44.838111 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:44.929057 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1321/2610] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:44 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:44.934610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:44.945110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971fa73-e85d-46c7-ac7a-d35a35ec70cf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:44.950591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:44.951221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:44.951670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:44.951954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:44.952841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:44.954536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:44.966047 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1290/2611] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:44.971067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:44.981706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ce3c9-6952-453e-978d-8f39b0c412ca admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:44.987784 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:44.988613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:44.988898 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:44.989180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] PATH_INFO: `/v3/projects/72bec93871ca4ad8802ca49edcb585ea/users/c8459ae21eed4873bf322d8f46d2152b/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:45.007674 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bec93871ca4ad8802ca49edcb585ea, user_id=c8459ae21eed4873bf322d8f46d2152b, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:45.010731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf3732-fbb4-4164-bbae-f4c6e07be621 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:45.085053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1322/2612] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:44 2022] PUT /identity/v3/projects/72bec93871ca4ad8802ca49edcb585ea/users/c8459ae21eed4873bf322d8f46d2152b/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:45.088009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:45.099937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4cf1e-ee9a-4c92-b9e2-abbe1a5d4f45 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:45.180708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d793900-59ec-4857-8207-46033e2043b9 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:45.181246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d793900-59ec-4857-8207-46033e2043b9 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:45.181678 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d793900-59ec-4857-8207-46033e2043b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:45.207704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7d793900-59ec-4857-8207-46033e2043b9 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:45.208858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7d793900-59ec-4857-8207-46033e2043b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:45.210451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:45.211804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:45.211804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:45.211804 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:45.212346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:45.214001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:45.232542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1291/2613] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:27:45.233433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:45.244866 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc3f9-267a-48f9-8954-a78b2d533799 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:45.256019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:45.256019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:45.256019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:45.256019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] PATH_INFO: `/v3/projects/72bec93871ca4ad8802ca49edcb585ea/users/c8459ae21eed4873bf322d8f46d2152b/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:45.256439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bec93871ca4ad8802ca49edcb585ea, user_id=c8459ae21eed4873bf322d8f46d2152b, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:45.258300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:45.260999 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:45.276825 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1292/2614] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:45 2022] PUT /identity/v3/projects/72bec93871ca4ad8802ca49edcb585ea/users/c8459ae21eed4873bf322d8f46d2152b/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:45.296711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1323/2615] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:45.311408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:45.314753 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:45.414975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e46f-f012-491b-85ff-080ff04994b4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:45.422348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:45.422543 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:45.422862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:45.423211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:45.494136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:45.495826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:45.504679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1293/2616] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:27:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:27:51.481957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:51.482439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:51.482559 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:51.524613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] MFA Rules not processed for user `c8459ae21eed4873bf322d8f46d2152b`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:51.529048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:51.564104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:51.604895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1324/2617] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:51.619945 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:51.621614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:51.700926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798343-b18f-42ab-aa8d-57260657bb44 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:51.708042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:51.708689 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:51.708973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:51.709246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:51.743137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:51.772502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:51.774164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:51.784227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1294/2618] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:53.331094 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:53.389170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3449-f341-4a0a-8dc5-08e23d1a4d9e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:53.393293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:53.394023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:53.394307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:53.394583 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:53.396361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:53.460695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:53.462291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:53.472899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1325/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:57.469835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:57.471440 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:57.487857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298681-457f-4fe3-bc97-32f18574d565 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:57.493146 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:57.493856 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:57.494170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:57.494451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] PATH_INFO: `/v3/users/47da4644803547869a303a039ee7a28c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:57.495670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=47da4644803547869a303a039ee7a28c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:57.498994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:57.670298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47da4644803547869a303a039ee7a28c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:57.670995 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47da4644803547869a303a039ee7a28c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:57.684211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47da4644803547869a303a039ee7a28c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:57.684938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47da4644803547869a303a039ee7a28c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:57.749446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0a1fb6db-a04e-4731-a637-8b2d2834cd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47da4644803547869a303a039ee7a28c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:57.762365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1295/2620] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:27:57 2022] DELETE /identity/v3/users/47da4644803547869a303a039ee7a28c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:58.037106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.052193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ab7d2-9bc5-444c-ba54-ef82714bef79 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.121680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.122648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.122934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.123219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] PATH_INFO: `/v3/projects/3f7ea2daaa864df7973b21d1d13ae47a` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.124445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7ea2daaa864df7973b21d1d13ae47a)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.126420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.151335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:58.266162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7ea2daaa864df7973b21d1d13ae47a', 'request_id': 'req-d7b224a5-92bf-4c1a-a6c1-709149026c10'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:58.275047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7ea2daaa864df7973b21d1d13ae47a', 'request_id': 'req-d7b224a5-92bf-4c1a-a6c1-709149026c10'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:58.282887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7ea2daaa864df7973b21d1d13ae47a', 'request_id': 'req-d7b224a5-92bf-4c1a-a6c1-709149026c10'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:58.372601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] The token cache is being invalidate because project 3f7ea2daaa864df7973b21d1d13ae47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:27:58.372897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:58.373517 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d7b224a5-92bf-4c1a-a6c1-709149026c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:27:58.375069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1326/2621] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:27:58 2022] DELETE /identity/v3/projects/3f7ea2daaa864df7973b21d1d13ae47a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:58.380481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.380795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.381076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.528073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:58.529299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:58.589323 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1296/2622] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:58.598420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.598713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.598995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.620819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:58.622127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:58.630909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1327/2623] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:58.635345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.645847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b1ca-2bea-47ac-be0e-026bfd6cc698 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.650363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.651024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.651430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.651569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.652266 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:27:58.652571 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.654186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.669982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1297/2624] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:27:58.674536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.683774 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc0cd2-9020-48b7-b898-fc183927e2b5 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.689123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.689747 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.690054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.690330 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.691011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.693002 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.782648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1328/2625] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:27:58 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:27:58.783984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.794248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919f4be-7a94-49f6-be60-c39fdccff702 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.824828 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:58.853845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.854401 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.854686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.854963 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.855629 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.857561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.931936 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1298/2626] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:27:58 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:27:58.935672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.947632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fc0f-f759-40eb-9cf8-5327ca068acd admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.953078 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.953809 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.954216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.954497 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.955203 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.956817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.967283 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1329/2627] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:58.972033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.982320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800abc3-8605-4ab8-b266-e703031cee96 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.988157 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.988770 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.989054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.989326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.990298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.991876 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d93c1-bcb6-41b8-a215-4dadfef68eff admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:59.002655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1299/2628] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:27:59.007565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:59.018515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316430d-5783-4c27-807e-53651fc157dc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:59.023207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:59.023873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:59.024156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:59.024437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] PATH_INFO: `/v3/projects/c6df4baf0a1242f2b73fe99071682355/users/fbb29845a13844f89fd004b401d27b8e/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:59.040045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6df4baf0a1242f2b73fe99071682355, user_id=fbb29845a13844f89fd004b401d27b8e, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:59.042768 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:59.150049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1330/2629] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:27:59 2022] PUT /identity/v3/projects/c6df4baf0a1242f2b73fe99071682355/users/fbb29845a13844f89fd004b401d27b8e/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:27:59.155692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86196d6-5b05-4e30-87bf-adc0f6adacfa None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:59.157236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86196d6-5b05-4e30-87bf-adc0f6adacfa None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:59.157582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86196d6-5b05-4e30-87bf-adc0f6adacfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:59.176772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e86196d6-5b05-4e30-87bf-adc0f6adacfa None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:59.182503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e86196d6-5b05-4e30-87bf-adc0f6adacfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:59.248480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1300/2630] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:27:59.258106 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:59.259846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:59.318582 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c14759-0cf5-4be0-a0bf-88aa45a45a6d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:59.322250 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:59.322875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:59.323165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:59.323444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:59.333516 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:59.334434 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:59.344926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1331/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:04.675479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3493b-457e-4358-af74-41a724140222 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:04.676014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3493b-457e-4358-af74-41a724140222 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:04.690058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3493b-457e-4358-af74-41a724140222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:04.706598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6ba3493b-457e-4358-af74-41a724140222 None None] MFA Rules not processed for user `fbb29845a13844f89fd004b401d27b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:04.707846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6ba3493b-457e-4358-af74-41a724140222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:04.789347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1301/2632] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:04.807034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:04.808454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:04.867408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:04.893336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3731-7094-4350-bbed-9ad88c595187 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:04.902462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:04.903192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:04.903475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:04.903749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:04.913375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:04.915022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d72748-aba9-4d6a-a881-52334a85c994 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:04.924266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1332/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:07.293715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:07.294347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:07.294347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:07.314870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] MFA Rules not processed for user `fbb29845a13844f89fd004b401d27b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:07.316081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:07.323126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1302/2634] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:28:11.479236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:11.486538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:11.486538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:11.501983 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] MFA Rules not processed for user `cc8d9f649a43450da28c0f7c2e4515ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:11.503525 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:11.578257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1333/2635] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:17.308650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:21.569813 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=37 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:32.005527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:32.025789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac29ac-5407-4625-9a8a-52876563ccd4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:32.029372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:32.030064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:32.030344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:32.030619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:32.032550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:32.129316 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:32.130774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:32.140246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1303/2636] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:36.649848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:36.651290 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:36.686158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6db3c-2df0-4ee3-8504-d473a9807a82 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:36.690561 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:36.691170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:36.691445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:36.691712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:36.693425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:36.726502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:36.727839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:36.747189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1334/2637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:40.514422 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:40.516674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:40.533516 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15b278-20d0-49b5-8fc9-95fc4513ed3c service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:40.538829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:40.540390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:40.540390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:40.540390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] PATH_INFO: `/v3/users/14c4c1027d8a42c081d69fa821216675` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:40.541486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c4c1027d8a42c081d69fa821216675)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:40.543445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:40.735411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c4c1027d8a42c081d69fa821216675'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:40.736006 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c4c1027d8a42c081d69fa821216675'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:40.748403 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c4c1027d8a42c081d69fa821216675'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:40.749065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c4c1027d8a42c081d69fa821216675'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:40.851283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-119ffa43-e6d4-43ae-a4ca-3c5eb264fabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c4c1027d8a42c081d69fa821216675'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:40.864377 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1304/2638] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:28:40 2022] DELETE /identity/v3/users/14c4c1027d8a42c081d69fa821216675 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:41.116654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.128633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19147ae5-517f-4f99-aa08-8e211b6d0b20 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.191499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.192142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.192429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.192705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] PATH_INFO: `/v3/projects/6bcd2b3241464b25a20c9d559ed9a049` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.193949 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcd2b3241464b25a20c9d559ed9a049)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.195857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.279471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcd2b3241464b25a20c9d559ed9a049', 'request_id': 'req-375577b5-a6ed-40a0-85a8-6e73899e838f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:41.286056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcd2b3241464b25a20c9d559ed9a049', 'request_id': 'req-375577b5-a6ed-40a0-85a8-6e73899e838f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:41.291544 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcd2b3241464b25a20c9d559ed9a049', 'request_id': 'req-375577b5-a6ed-40a0-85a8-6e73899e838f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:41.347920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] The token cache is being invalidate because project 6bcd2b3241464b25a20c9d559ed9a049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:28:41.348201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:41.348815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-375577b5-a6ed-40a0-85a8-6e73899e838f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:41.350408 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1335/2639] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:28:41 2022] DELETE /identity/v3/projects/6bcd2b3241464b25a20c9d559ed9a049 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:28:41.355555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.355991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.356271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.394768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:41.415744 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:41.416947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:41.475018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1305/2640] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:41.483136 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.483431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.483717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.504028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:41.505230 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:41.513300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1336/2641] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:41.517690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.527352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ddb2b-6440-45eb-acc1-d8e9e1407102 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.532725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.533336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.533623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.533960 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.534655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:28:41.534959 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.536647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.548845 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1306/2642] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:28:41.553253 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.563396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c6590-e1b7-4a8c-9b36-44b29d73af3c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.568176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.568789 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.569071 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.569347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.570167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.572072 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.651667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:41.659241 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1337/2643] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:28:41 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:28:41.663547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.674007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1637-eb0b-4f52-be72-7468df447b74 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.731071 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.731688 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.731971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.732248 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.732900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.735477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.830287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1307/2644] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:28:41 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:28:41.834173 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.845500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0235a-ed2f-4e53-a013-27d2e9704a18 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.850252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.850876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.851158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.851431 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.852238 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.853846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.865007 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1338/2645] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:41.868993 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.879697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305e542-7c29-4160-a4cf-8c8bae39e257 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.884253 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.884851 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.885133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.885406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.886250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.888059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699b781-aaf9-4e3a-944f-47b7037553bd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.898562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1308/2646] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:28:41.902800 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:41.913425 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd59f2-6191-4d04-aa4e-a9f916dfa24b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:41.918083 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:41.918746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:41.919096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:41.919376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] PATH_INFO: `/v3/projects/f504050fe9394c6da08c8916ea56e016/users/fe5405ddce61451e9f3d0b61d222db44/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:41.934619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f504050fe9394c6da08c8916ea56e016, user_id=fe5405ddce61451e9f3d0b61d222db44, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:41.937246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:41.999038 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1339/2647] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:28:41 2022] PUT /identity/v3/projects/f504050fe9394c6da08c8916ea56e016/users/fe5405ddce61451e9f3d0b61d222db44/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:28:42.010801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:42.011087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:42.011364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:42.039582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] MFA Rules not processed for user `fe5405ddce61451e9f3d0b61d222db44`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:42.041217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:42.088418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:42.107390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1309/2648] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:42.133193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:42.134935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:42.235395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be825c6b-78fd-4351-8922-b7cb18849be1 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:42.241263 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:42.241913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:42.242200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:42.242478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:42.250993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:42.253787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88689b8-bcb8-46fb-8b3d-0233b69702a8 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:42.261564 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1340/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:45.432705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:45.493871 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734788e-8414-4067-a20b-fb4f9954fd94 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:45.498667 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:45.499535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:45.499815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:45.500090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] PATH_INFO: `/v3/users/fe5405ddce61451e9f3d0b61d222db44` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:45.502179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5405ddce61451e9f3d0b61d222db44)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:45.504372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:45.722817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5405ddce61451e9f3d0b61d222db44'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:45.723500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5405ddce61451e9f3d0b61d222db44'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:45.736275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5405ddce61451e9f3d0b61d222db44'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:45.736939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5405ddce61451e9f3d0b61d222db44'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:45.821574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5405ddce61451e9f3d0b61d222db44'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:45.834743 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1310/2650] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:28:45 2022] DELETE /identity/v3/users/fe5405ddce61451e9f3d0b61d222db44 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:45.839244 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:45.839717 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:45.842225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:45.860799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:45.862319 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:45.921419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1341/2651] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:45.931883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:45.933355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:46.013465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9233b1-ae6c-461e-87d6-fbbd53b4f767 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:46.017603 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:46.018254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.018530 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.018797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.024698 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:46.028275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:46.029679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d616be-6234-4885-bcc1-5a9637746ab9 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:46.039388 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1311/2652] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:46.459364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:46.460861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:46.477213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129383-b18c-4caf-99cc-e1fc87440fc0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:46.483024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:46.483771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.483956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.484208 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] PATH_INFO: `/v3/projects/f504050fe9394c6da08c8916ea56e016` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.485998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f504050fe9394c6da08c8916ea56e016)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:46.487901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:46.509156 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:46.618091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f504050fe9394c6da08c8916ea56e016', 'request_id': 'req-c098ccec-61f4-42de-932c-954c5a6437ac'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:46.624107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f504050fe9394c6da08c8916ea56e016', 'request_id': 'req-c098ccec-61f4-42de-932c-954c5a6437ac'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:46.631197 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f504050fe9394c6da08c8916ea56e016', 'request_id': 'req-c098ccec-61f4-42de-932c-954c5a6437ac'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:46.713044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] The token cache is being invalidate because project f504050fe9394c6da08c8916ea56e016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:28:46.713324 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:46.713966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c098ccec-61f4-42de-932c-954c5a6437ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:46.715530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1342/2653] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:28:46 2022] DELETE /identity/v3/projects/f504050fe9394c6da08c8916ea56e016 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:46.721621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.722122 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.722237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.742107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:46.747205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:46.803380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1312/2654] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:46.811260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.811552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.811835 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.832432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:46.833729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:46.841537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1343/2655] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:46.846065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:46.855746 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e133864-dcf9-46f8-9a3b-029e9557f50b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:46.861111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:46.861721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.862033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.862304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.862988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:28:46.863285 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:46.865102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:46.877224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1313/2656] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:28:46.881578 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:46.891260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3d091-b435-4123-952b-0a602b852162 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:46.896003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:46.896601 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:46.896878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:46.897149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:46.897828 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:46.899755 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.003797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1344/2657] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:28:46 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:28:47.008263 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.019046 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebcc52-9ef8-4507-9a31-861b21239c27 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.073718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.074365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.074648 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.074924 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.075598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.077499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.165289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1314/2658] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:28:47 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:28:47.169405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.180084 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc1a7d-a567-48aa-8e8d-cdd5ef92cc2b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.185709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.185709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.185709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.186034 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.186537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.188632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.198644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1345/2659] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:47.202723 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.213718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6407-7ae8-4b94-9347-5fffb934722b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.218572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.219181 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.219490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.219780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.220457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.222078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f24af-75d0-4ce0-a12a-3e5bd565858c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.232548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1315/2660] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:47.236695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.246759 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5746e-d66e-44a8-b489-a12774900b2c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.252079 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.252727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.253030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.253288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] PATH_INFO: `/v3/projects/70964f5718dd4951b8ee9eb054f4288b/users/7c9c5e6d844445ceb54763d8c359e69c/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.267956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=70964f5718dd4951b8ee9eb054f4288b, user_id=7c9c5e6d844445ceb54763d8c359e69c, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.270673 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.336873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1346/2661] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:28:47 2022] PUT /identity/v3/projects/70964f5718dd4951b8ee9eb054f4288b/users/7c9c5e6d844445ceb54763d8c359e69c/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:47.347355 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.347640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.347916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.374931 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] MFA Rules not processed for user `7c9c5e6d844445ceb54763d8c359e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:47.377077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:47.421914 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:47.439789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1316/2662] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:47 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:28:47.473996 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.475684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:47.554894 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306914cc-0423-41c6-a3b1-0ead0de674ff admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.558616 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.559225 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.559510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.559786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.568697 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.570188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58ea6b-7a30-4532-808f-96e86d95f955 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.579082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1347/2663] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:47 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:47.594228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:47.654797 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b89b-6f7b-4b54-b475-2c98290a643f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:47.659389 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:47.660026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.660307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.660583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] PATH_INFO: `/v3/users/7c9c5e6d844445ceb54763d8c359e69c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:47.661767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9c5e6d844445ceb54763d8c359e69c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:47.663802 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:47.869817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9c5e6d844445ceb54763d8c359e69c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:47.870510 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9c5e6d844445ceb54763d8c359e69c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:47.884863 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9c5e6d844445ceb54763d8c359e69c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:47.891895 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9c5e6d844445ceb54763d8c359e69c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:47.971527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9c5e6d844445ceb54763d8c359e69c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:47.984798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1317/2664] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:28:47 2022] DELETE /identity/v3/users/7c9c5e6d844445ceb54763d8c359e69c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:47.990267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:47.990740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:47.990867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.011143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:48.012342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.030932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:48.072214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1348/2665] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:48.082275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:48.083717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.141491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9ce9a-2102-401e-94c0-e64a0b20da3d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:48.145201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:48.145834 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.146115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.146387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.155139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:48.156544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8389c44-77e5-49ac-a830-0b4953db1a07 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:48.166561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1318/2666] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:48.617506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:48.619771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.633518 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd569-1167-445e-b88b-9465e9e8e9f8 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:48.638662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:48.639683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.639966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.640383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] PATH_INFO: `/v3/projects/70964f5718dd4951b8ee9eb054f4288b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.642514 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70964f5718dd4951b8ee9eb054f4288b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:48.644491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:48.743235 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70964f5718dd4951b8ee9eb054f4288b', 'request_id': 'req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:48.749420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70964f5718dd4951b8ee9eb054f4288b', 'request_id': 'req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:48.755643 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70964f5718dd4951b8ee9eb054f4288b', 'request_id': 'req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:48.834401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] The token cache is being invalidate because project 70964f5718dd4951b8ee9eb054f4288b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:28:48.834693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:48.835318 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3d20e65f-a9c5-4c58-a00d-2367c5221a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:48.836846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1349/2667] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:28:48 2022] DELETE /identity/v3/projects/70964f5718dd4951b8ee9eb054f4288b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:48.841677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.842005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.845184 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.862836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:48.863991 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.869378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:48.923550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1319/2668] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:48.932773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.933064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.933350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.952911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:48.954317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.962160 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1350/2669] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:48.966303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:48.976810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5308-4eef-43fe-ae8b-6aff8f57212f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:48.981312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:48.981956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.982236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.982507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.983211 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:28:48.983513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:48.986073 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:48.997697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1320/2670] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:28:49.002025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.011284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31824291-3cd2-42cd-9794-9a460cead67b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.015999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.017196 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.017484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.017781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.018459 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.020360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.087170 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1351/2671] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:28:49 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:28:49.091513 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.102283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65e08-7a2e-4346-9180-76e6d2125497 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.158494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.159037 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.159322 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.159599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.160254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.162179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.239896 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1321/2672] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:28:49 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:28:49.244052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.254740 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f74ce2-eca7-4103-9d19-cc9985e24012 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.259549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.260149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.260430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.260708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.261433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.263030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.273512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1352/2673] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:49.277289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.288172 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636504-0c73-4a8e-a22e-a43f4453d39c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.292640 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.293235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.293514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.293812 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.294490 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.296053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c3c1-56b5-483c-99be-b9954b2634ea admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.306758 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1322/2674] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:49.310919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.320729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaca66-7301-40a3-9020-49cbc43ad861 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.325255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.325964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.326252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.326535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] PATH_INFO: `/v3/projects/1d3ebdfb4edd4ba1ad6438a68e325219/users/3c12318332b64ca1b1b9937852215eaa/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.341246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3ebdfb4edd4ba1ad6438a68e325219, user_id=3c12318332b64ca1b1b9937852215eaa, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.343932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.415279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1353/2675] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:28:49 2022] PUT /identity/v3/projects/1d3ebdfb4edd4ba1ad6438a68e325219/users/3c12318332b64ca1b1b9937852215eaa/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:49.420364 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a13b-3734-4077-8ce9-9fa172867add None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.420721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a13b-3734-4077-8ce9-9fa172867add None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.421094 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3a13b-3734-4077-8ce9-9fa172867add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.440195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-49a3a13b-3734-4077-8ce9-9fa172867add None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:49.441390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-49a3a13b-3734-4077-8ce9-9fa172867add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:49.501448 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1323/2676] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:49.511166 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:49.512875 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:49.559389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:49.571224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604641-0fb8-4daa-b48c-25d99bf28c90 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:49.574973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:49.575658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:49.575938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:49.576213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:49.586257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:49.588176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:49.598015 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1354/2677] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:50.845107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09eb6-4062-49b8-89c4-9a96e09b7147 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:50.845641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09eb6-4062-49b8-89c4-9a96e09b7147 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:50.845641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09eb6-4062-49b8-89c4-9a96e09b7147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:50.874561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-94f09eb6-4062-49b8-89c4-9a96e09b7147 None None] MFA Rules not processed for user `3c12318332b64ca1b1b9937852215eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:50.883010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-94f09eb6-4062-49b8-89c4-9a96e09b7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:50.883010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:50.941847 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1324/2678] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:50.955412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:50.956924 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:51.017483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487d87-f3f8-430b-8d77-dfc8ae4b8ea9 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:51.021027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:51.021641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:51.021955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:51.022237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:51.030662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:51.032669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:51.041676 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1355/2679] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:52.807534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7e56-3ff5-404e-9c93-b7e71b1a55f4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:52.808041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7e56-3ff5-404e-9c93-b7e71b1a55f4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:52.808152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7e56-3ff5-404e-9c93-b7e71b1a55f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:52.827286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9b5f7e56-3ff5-404e-9c93-b7e71b1a55f4 None None] MFA Rules not processed for user `3c12318332b64ca1b1b9937852215eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:52.828477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9b5f7e56-3ff5-404e-9c93-b7e71b1a55f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:52.835515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1325/2680] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:54.819506 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:54.820959 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:54.911374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f2651-c945-4dd0-aef1-1d0f4c89b55d service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:54.916444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:54.917058 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:54.917339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:54.917614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:54.919378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:54.930721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:54.932292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafda11e-e6b4-442d-b6ff-0d04d8324f53 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:54.942790 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1356/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:29:02.822106 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=27 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:04.938093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=73 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:13.763420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa263-7fe5-40c9-8a5b-817d079db73f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:13.764111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa263-7fe5-40c9-8a5b-817d079db73f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:13.764111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa263-7fe5-40c9-8a5b-817d079db73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:13.788544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4bcfa263-7fe5-40c9-8a5b-817d079db73f None None] MFA Rules not processed for user `3c12318332b64ca1b1b9937852215eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:29:13.789899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4bcfa263-7fe5-40c9-8a5b-817d079db73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:13.813452 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1326/2682] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:29:14.426819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:14.426819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:14.426819 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:14.446052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] MFA Rules not processed for user `fbb29845a13844f89fd004b401d27b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:29:14.447297 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:14.521465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1357/2683] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:29:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:29:23.784738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:24.513382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=25 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:44.104026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b4ad-759f-4fa0-a3c8-aa5ca985509d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:44.104555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b4ad-759f-4fa0-a3c8-aa5ca985509d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:44.104555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b4ad-759f-4fa0-a3c8-aa5ca985509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:44.133152 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4e83b4ad-759f-4fa0-a3c8-aa5ca985509d None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:29:44.134384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4e83b4ad-759f-4fa0-a3c8-aa5ca985509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:44.188432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1327/2684] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:29:44.318087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:29:44.319512 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:44.388666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655d16d-18b5-4cde-960d-beaef71d2d6c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:29:44.393890 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:29:44.394508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:44.394812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:44.395063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:44.403922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:29:44.405493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:29:44.414652 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1358/2685] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:29:54.181782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=29 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:54.410556 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=32 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:00.468493 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:00.468941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:00.469134 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:00.488066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:00.489596 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:00.496769 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1328/2686] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:30:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:00.509482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:00.520185 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff297c-0ecf-44bc-8bd4-9bd05b2ac048 service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:00.526357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:00.527009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:00.527288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:00.527560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:00.535846 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:00.537622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:00.545542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1359/2687] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:03.244844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:03.256930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c363204-317e-4605-b78a-697c0a60c83c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:03.261537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:03.262221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:03.262569 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:03.262850 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] PATH_INFO: `/v3/users/3c12318332b64ca1b1b9937852215eaa` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:03.264031 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c12318332b64ca1b1b9937852215eaa)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:03.266034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:03.463375 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c12318332b64ca1b1b9937852215eaa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:03.463982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c12318332b64ca1b1b9937852215eaa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:03.475922 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c12318332b64ca1b1b9937852215eaa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:03.476560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c12318332b64ca1b1b9937852215eaa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:03.575556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c3d985d6-8f52-41c4-b61e-6b10b809d4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c12318332b64ca1b1b9937852215eaa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:03.589611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1329/2688] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:30:03 2022] DELETE /identity/v3/users/3c12318332b64ca1b1b9937852215eaa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:03.822455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:03.835893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657b08-191c-4c68-9801-7d41d878f16f service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:03.900631 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:03.901279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:03.901563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:03.901877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] PATH_INFO: `/v3/projects/1d3ebdfb4edd4ba1ad6438a68e325219` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:03.903029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3ebdfb4edd4ba1ad6438a68e325219)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:03.904939 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.019951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3ebdfb4edd4ba1ad6438a68e325219', 'request_id': 'req-874753f6-dd68-4fd0-9bd3-bcb623500788'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:04.022449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3ebdfb4edd4ba1ad6438a68e325219', 'request_id': 'req-874753f6-dd68-4fd0-9bd3-bcb623500788'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:04.028350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3ebdfb4edd4ba1ad6438a68e325219', 'request_id': 'req-874753f6-dd68-4fd0-9bd3-bcb623500788'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:04.107247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] The token cache is being invalidate because project 1d3ebdfb4edd4ba1ad6438a68e325219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:30:04.107539 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:04.108158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-874753f6-dd68-4fd0-9bd3-bcb623500788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:04.109723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1360/2689] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:30:03 2022] DELETE /identity/v3/projects/1d3ebdfb4edd4ba1ad6438a68e325219 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:04.115055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.117868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.117868 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.136614 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:04.137849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:04.195835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1330/2690] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:04.203465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.203761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.204164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.223521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:04.225233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:04.233044 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1361/2691] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:04.237213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.247737 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2343e-55cb-4e24-808c-5386c347017a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.252350 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.252957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.253243 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.253521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.254252 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:30:04.254559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.256277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.267606 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1331/2692] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:30:04.272042 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.281364 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff14f35-3964-462e-848c-7c369b489676 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.285957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.286563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.286842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.287622 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.288279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.290209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.393744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1362/2693] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:30:04 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:04.398566 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.408363 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b984-666f-4194-8327-88cc750f2cf8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.454488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:04.463728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.464349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.464631 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.464905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.465594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.467581 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.587763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1332/2694] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:30:04 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:04.592118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.602895 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b52b-63a5-434c-b570-bb2c01de708c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.607422 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.608028 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.608338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.608590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.609279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.610907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.621115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1363/2695] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:30:04.625020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.635177 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69e90-6d5d-4d71-b1f0-bb53092b2f0b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.640705 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.641303 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.641584 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.641899 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.642594 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.644716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1ca2e-ad47-41b6-9cee-822cbe2eb064 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.655982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1333/2696] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:04.659947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.670463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892bf2-4c06-40e3-b262-6c84a323dd8a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.674977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.675626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.675907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.676181 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] PATH_INFO: `/v3/projects/6fd0ec803e7846659dd3afff6d1b9af7/users/730b210a10534a4bbf0a58ae47429f08/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.690444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd0ec803e7846659dd3afff6d1b9af7, user_id=730b210a10534a4bbf0a58ae47429f08, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.693122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.764799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1364/2697] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:04 2022] PUT /identity/v3/projects/6fd0ec803e7846659dd3afff6d1b9af7/users/730b210a10534a4bbf0a58ae47429f08/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:04.776414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.776704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.776982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.804669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] MFA Rules not processed for user `730b210a10534a4bbf0a58ae47429f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:04.805964 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:04.869733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1334/2698] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:04.881460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:04.883501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:04.898782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:04.941246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4c9cb-9e30-45fa-a473-2c2f4903aaa2 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:04.945966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:04.946591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:04.946873 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:04.947148 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:04.955994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:04.957415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73f087-d0e3-429d-b00e-0fa8c6bad651 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:04.967065 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1365/2699] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:04.994041 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:05.056016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490161d-7659-4b48-8b19-4705f0d8a4bd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:05.060591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:05.061224 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:05.061508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:05.061810 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] PATH_INFO: `/v3/users/730b210a10534a4bbf0a58ae47429f08` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:05.062975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=730b210a10534a4bbf0a58ae47429f08)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:05.064875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:05.250102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730b210a10534a4bbf0a58ae47429f08'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:05.250731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730b210a10534a4bbf0a58ae47429f08'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:05.261395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:05.262626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730b210a10534a4bbf0a58ae47429f08'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:05.263273 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730b210a10534a4bbf0a58ae47429f08'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:05.356534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730b210a10534a4bbf0a58ae47429f08'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:05.369366 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1335/2700] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:30:04 2022] DELETE /identity/v3/users/730b210a10534a4bbf0a58ae47429f08 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:05.377860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:05.377860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:05.377860 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:05.393322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:05.394555 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:05.456167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1366/2701] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:05.466590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:05.468040 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:05.525577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c0417-9e8b-47cb-ad2d-723ab297b7ff admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:05.529206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:05.529855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:05.530144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:05.530424 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:05.540117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:05.541544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14823-ce04-4e53-9e3f-945bba9941a0 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:05.551630 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1336/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:05.954032 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:05.955489 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:05.967646 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723054-8847-4a12-86f5-af1ed50813c1 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:05.972326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:05.973020 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:05.973302 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:05.973569 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] PATH_INFO: `/v3/projects/6fd0ec803e7846659dd3afff6d1b9af7` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:05.974788 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd0ec803e7846659dd3afff6d1b9af7)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:05.979157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.142031 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd0ec803e7846659dd3afff6d1b9af7', 'request_id': 'req-d48982a4-bb31-4668-ba65-5238c39297a0'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:06.148259 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd0ec803e7846659dd3afff6d1b9af7', 'request_id': 'req-d48982a4-bb31-4668-ba65-5238c39297a0'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:06.153699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd0ec803e7846659dd3afff6d1b9af7', 'request_id': 'req-d48982a4-bb31-4668-ba65-5238c39297a0'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:06.249236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] The token cache is being invalidate because project 6fd0ec803e7846659dd3afff6d1b9af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:30:06.249542 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:06.250215 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d48982a4-bb31-4668-ba65-5238c39297a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:06.251724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1367/2703] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:30:05 2022] DELETE /identity/v3/projects/6fd0ec803e7846659dd3afff6d1b9af7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:06.256794 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.257302 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.257407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.276627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:06.277885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:06.337019 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1337/2704] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:06.344641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.344935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.345217 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.365435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:06.366724 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:06.375039 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1368/2705] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:06.379191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.389485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2f5a9-3425-41a2-a094-0adc013584ce None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.394125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.394755 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.395064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.395337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.396025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:30:06.396344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.398531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.410306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1338/2706] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:30:06.414944 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.423987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535a95-3cc1-4248-be0a-4a570b72e940 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.428558 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.429167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.430367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.430367 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.430962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.432841 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.548303 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1369/2707] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:30:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:30:06.552435 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.562560 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42d57-2010-47e8-b9fd-e2ce9fe52f14 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.616803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.617333 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.617615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.617923 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.618600 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.620475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.729988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:06.735082 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1339/2708] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:30:06 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:30:06.739511 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.749995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598c22-1670-4b4f-9f9a-9d7db54b30cc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.754554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.755157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.755439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.755712 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.756406 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.758169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.763660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:06.768803 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1370/2709] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:06.773432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.783933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf3885-f8eb-4ab2-a2ef-66124e03bce1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.788602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.789998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.790317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.790601 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.791304 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.792932 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92164759-08c7-4d82-b2b6-08f3d4c43ee3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.805405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1340/2710] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:06.809533 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:06.819670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f359-6fbc-4e31-b0a2-6dfb9e4b60d7 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:06.824174 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:06.824823 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.825103 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.825378 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] PATH_INFO: `/v3/projects/937e807649094f70844259eafaef26b1/users/0f18192b9dd241909b1957a7d43858c3/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.841201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937e807649094f70844259eafaef26b1, user_id=0f18192b9dd241909b1957a7d43858c3, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:06.843981 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:06.911796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1371/2711] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:06 2022] PUT /identity/v3/projects/937e807649094f70844259eafaef26b1/users/0f18192b9dd241909b1957a7d43858c3/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:06.917413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04af9-ab9a-4944-aeb5-c574f2d808de None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:06.917865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04af9-ab9a-4944-aeb5-c574f2d808de None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:06.918141 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e04af9-ab9a-4944-aeb5-c574f2d808de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:06.938090 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f6e04af9-ab9a-4944-aeb5-c574f2d808de None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:06.939293 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6e04af9-ab9a-4944-aeb5-c574f2d808de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:06.997081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1341/2712] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:07.006705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:07.008995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:07.066397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73bcf-c3d5-4bed-838d-f0eab1a1a646 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:07.070547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:07.071153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:07.071435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:07.071711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:07.080715 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:07.082168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:07.092152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1372/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:30:12.535433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:12.536014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:12.536119 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:12.567247 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] MFA Rules not processed for user `0f18192b9dd241909b1957a7d43858c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:12.568474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:12.636551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1342/2714] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:12.641252 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:12.651845 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad36f-b90d-4ebc-aedc-e59de461499c service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:12.656604 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:12.657228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:12.657515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:12.657826 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:12.658508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:12.660429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:12.769361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1373/2715] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:30:12 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:12.774655 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:12.785844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e56d-4e10-4a54-8796-daa56a91c304 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:12.853778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:12.854554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:12.854912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:12.855258 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:12.856001 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:12.858034 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:12.932379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1343/2716] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:30:12 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:12.935935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:12.957847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5431-59c6-4775-adc3-58c61cd0cfbe admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:12.963006 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:12.963688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:12.963977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:12.964343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:12.965067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:12.966785 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:12.979021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1374/2717] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:12.983236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:12.997054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312d54-6015-4864-8bd8-f6d6fcd6389b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:13.003085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:13.003775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:13.004111 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:13.004578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] PATH_INFO: `/v3/projects/742ef4197c4343d8897806a2e5a0a62a/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:13.009280 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:13.021354 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742ef4197c4343d8897806a2e5a0a62a, user_id=6a3f87dbd7a34e3fbfe89d2cfd9aa331, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:13.025469 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:13.091775 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1344/2718] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:12 2022] PUT /identity/v3/projects/742ef4197c4343d8897806a2e5a0a62a/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:13.096563 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:13.108153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a550c-a0f8-42e4-b526-6001ba89b13b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:13.168914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:13.169543 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:13.169862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:13.170142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:13.170848 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:13.172449 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dceaad9-d600-459c-bf31-747d52ecad1e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:13.184658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1375/2719] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:13.188070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:13.199126 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbdcf-946e-4d6a-b2fa-d8180bc4f2e8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:13.206414 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:13.207208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:13.207498 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:13.207832 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] PATH_INFO: `/v3/projects/742ef4197c4343d8897806a2e5a0a62a/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:13.209956 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742ef4197c4343d8897806a2e5a0a62a, user_id=6a3f87dbd7a34e3fbfe89d2cfd9aa331, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:13.213666 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:13.225194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1345/2720] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:13 2022] PUT /identity/v3/projects/742ef4197c4343d8897806a2e5a0a62a/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:19.067169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeef80-b62c-4e7d-a94c-f1f0d4c56e28 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:19.068770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeef80-b62c-4e7d-a94c-f1f0d4c56e28 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:19.068770 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeef80-b62c-4e7d-a94c-f1f0d4c56e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:19.102883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bdaeef80-b62c-4e7d-a94c-f1f0d4c56e28 None None] MFA Rules not processed for user `6a3f87dbd7a34e3fbfe89d2cfd9aa331`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:19.104153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bdaeef80-b62c-4e7d-a94c-f1f0d4c56e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:19.139977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:19.182584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1376/2721] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:19.196483 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:19.198249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:19.264329 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368a70-3197-42d8-94e7-9eb4a5630264 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:19.303297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c38ed92e03418ebf01b62f99a897c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:19.304598 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:19.305455 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:19.305900 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:19.388650 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:19.390267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:19.401996 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1346/2722] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:19.708648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:19.709013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:19.709219 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:19.744003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:19.747720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:19.824615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1377/2723] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:19.837557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:19.839015 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:19.918908 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f846a2-c63b-4f60-b65b-b59e7fe22604 service glance] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:19.923972 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:19.924605 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:19.924901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:19.925175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:19.935013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:19.936615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:19.945718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1347/2724] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:30:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:28.464275 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:28.543899 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46fff3-f36e-43c5-8427-7f30762a9ea0 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:28.551393 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:28.552050 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:28.552403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:28.552752 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:28.557970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:28.645369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:28.647158 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dda24-fa94-4091-8faf-7dcd7b8bdac1 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:28.662854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1378/2725] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:29.881175 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:29.892462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683543-1957-4088-b493-68b860b81fd7 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:29.900347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:29.900347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:29.900347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:29.900347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:29.902244 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:29.919165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:29.920693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbcc6f-5cfc-441a-b8fb-865324cdacd1 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:29.937980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1348/2726] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:30.799400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:30.799926 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:30.800142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:30.824054 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] MFA Rules not processed for user `0f18192b9dd241909b1957a7d43858c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:30.824987 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:30.835033 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1379/2727] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:30:36.286149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a01ef-0dc3-48a5-b8eb-4a3cd4a22cf1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:36.287072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a01ef-0dc3-48a5-b8eb-4a3cd4a22cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:36.287420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a01ef-0dc3-48a5-b8eb-4a3cd4a22cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:36.300332 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:36.325372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-719a01ef-0dc3-48a5-b8eb-4a3cd4a22cf1 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:36.325372 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-719a01ef-0dc3-48a5-b8eb-4a3cd4a22cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:36.330008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1349/2728] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Aug 1 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:36.346732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:36.363175 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65fc57-f5e0-4fe9-a48b-d076e6c95be2 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:36.371326 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:36.372632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:36.372920 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:36.373194 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:36.379650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:36.386619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:36.388735 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c233de3-68d8-42aa-a763-d559aa90c2f8 service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:36.411344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1380/2729] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:30:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:39.144457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:39.145020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:39.145020 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:39.189840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] MFA Rules not processed for user `fbb29845a13844f89fd004b401d27b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:39.196468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:39.294706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1350/2730] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:42.099273 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:42.099887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:42.099887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:42.158832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] MFA Rules not processed for user `cc8d9f649a43450da28c0f7c2e4515ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:42.160186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:42.268854 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1381/2731] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:42.772201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:42.783953 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78bf9c-2b75-47d0-8670-7db736928faf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:42.788216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:42.789139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:42.789651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:42.790201 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:42.793633 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:42.807132 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:42.808725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:42.818445 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1351/2732] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:44.252291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:44.253990 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:44.335531 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2d69-0c86-49e5-8a86-8d60886df1b3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:44.342091 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:44.342945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:44.343420 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:44.343691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:44.345957 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:44.366815 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:44.368667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:44.393884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1382/2733] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:52.814840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=33 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:54.376536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=60 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:56.473846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:56.475349 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:56.485870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215c6e-6632-4b2e-8e44-d04640c828f4 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:56.489799 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:56.490394 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:56.490679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:56.490955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:56.493301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:56.506786 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:56.511068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:56.526554 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1352/2734] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:03.066618 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:03.077382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549d8a-7501-489b-b22e-e195426a30e6 service placement] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:03.081261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:03.081997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:03.082349 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:03.082695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:03.084554 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:03.160857 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:03.162455 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:03.173893 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1383/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:06.519714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:09.472376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:09.481930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a18a6-9a70-43d0-96ad-f5a18e6f4a2a service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:09.485593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:09.486235 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:09.486515 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:09.486789 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:09.498016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:09.499433 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:09.510815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1353/2736] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:12.419548 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:12.422922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:12.445125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c4b0-1445-4ce9-ae35-b8daf8d80699 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:12.450281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:12.450936 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:12.451229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:12.451509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] PATH_INFO: `/v3/users/cb2ef56494054dd2ac1c18bee82f2a25` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:12.452682 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2ef56494054dd2ac1c18bee82f2a25)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:12.454703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:12.702913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2ef56494054dd2ac1c18bee82f2a25'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:12.704141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2ef56494054dd2ac1c18bee82f2a25'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:12.723376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2ef56494054dd2ac1c18bee82f2a25'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:12.734222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2ef56494054dd2ac1c18bee82f2a25'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:12.752344 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:12.753788 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:12.784488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a96249-98bd-474d-b45f-6604863bf3fb service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:12.795687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:12.796563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:12.796947 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:12.797462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:12.800387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:12.816254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:12.817985 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:12.833927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1354/2737] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:31:12.871088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2ef56494054dd2ac1c18bee82f2a25'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:12.889154 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1384/2738] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:12 2022] DELETE /identity/v3/users/cb2ef56494054dd2ac1c18bee82f2a25 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:13.501396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:13.516599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985d1a7-cd56-4d7d-a97f-ecbe030f354d service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:13.617272 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:13.618313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:13.618665 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:13.619009 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] PATH_INFO: `/v3/projects/c982cea0e664473ca8df5da87fbe6d73` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:13.620427 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c982cea0e664473ca8df5da87fbe6d73)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:13.626862 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:13.769107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c982cea0e664473ca8df5da87fbe6d73', 'request_id': 'req-bda5fc2a-7765-41c3-9d73-50f09886e734'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:13.781010 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c982cea0e664473ca8df5da87fbe6d73', 'request_id': 'req-bda5fc2a-7765-41c3-9d73-50f09886e734'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:13.789434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c982cea0e664473ca8df5da87fbe6d73', 'request_id': 'req-bda5fc2a-7765-41c3-9d73-50f09886e734'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:13.918474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] The token cache is being invalidate because project c982cea0e664473ca8df5da87fbe6d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:13.918768 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:13.919449 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:13.923892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1355/2739] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:13 2022] DELETE /identity/v3/projects/c982cea0e664473ca8df5da87fbe6d73 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:13.925338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:13.926851 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:13.948346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455dd12-54e9-4d74-8ed4-5ba14ac41a8f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:14.010607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:14.011266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:14.011568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:14.011872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] PATH_INFO: `/v3/users/e27dbc92493449dfac4538afb6f061c6` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:14.013062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27dbc92493449dfac4538afb6f061c6)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:14.015021 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:14.020658 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:14.205213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27dbc92493449dfac4538afb6f061c6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.206249 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27dbc92493449dfac4538afb6f061c6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.218716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27dbc92493449dfac4538afb6f061c6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.225401 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27dbc92493449dfac4538afb6f061c6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.345688 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-646fa87a-bed7-42cd-be2c-ba880267b2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27dbc92493449dfac4538afb6f061c6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.366432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1385/2740] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:13 2022] DELETE /identity/v3/users/e27dbc92493449dfac4538afb6f061c6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:14.736030 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:14.739000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:14.762488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fc2a-7765-41c3-9d73-50f09886e734 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:14.824076 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:14.824745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:14.824941 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:14.825221 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] PATH_INFO: `/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:14.826405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b593a17c67e1449eaeeb3cd10cb5d582)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:14.828326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:14.834787 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:14.941191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b593a17c67e1449eaeeb3cd10cb5d582', 'request_id': 'req-5abd96fc-72a9-474f-bc5c-a316b191411e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.947912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b593a17c67e1449eaeeb3cd10cb5d582', 'request_id': 'req-5abd96fc-72a9-474f-bc5c-a316b191411e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:14.954759 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b593a17c67e1449eaeeb3cd10cb5d582', 'request_id': 'req-5abd96fc-72a9-474f-bc5c-a316b191411e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.048586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] The token cache is being invalidate because project b593a17c67e1449eaeeb3cd10cb5d582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:15.048882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.049912 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.051109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1356/2741] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:14 2022] DELETE /identity/v3/projects/b593a17c67e1449eaeeb3cd10cb5d582 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:25.043168 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:25.985839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:06.723975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:06.724508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:06.724508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:06.744110 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] MFA Rules not processed for user `fbb29845a13844f89fd004b401d27b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:06.749233 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:06.801694 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1386/2742] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:16.329283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:16.330781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:16.403957 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd96fc-72a9-474f-bc5c-a316b191411e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:16.409462 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:16.410110 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:16.410398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:16.410674 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:16.412408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:16.424317 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:16.426546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c331235-e7cd-4e62-8968-60400160f812 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:16.437368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1357/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:16.794849 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=25 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:20.538946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:20.540444 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:20.557223 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882cad-7d99-4559-973e-2560c7b0e2bf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:20.562726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b73ce0aeb0846d88bf3e4b21405eda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:20.563352 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:20.563632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:20.563909 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:20.565624 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:20.578689 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:20.580265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:20.591082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1387/2744] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:32:26.432620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=34 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:30.586568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=6 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:39.870704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118548-57de-4aef-b7e5-74074d785412 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:39.871168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118548-57de-4aef-b7e5-74074d785412 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:39.871291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118548-57de-4aef-b7e5-74074d785412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:39.920818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-77118548-57de-4aef-b7e5-74074d785412 None None] MFA Rules not processed for user `d6805ff422004601b0e93eb98138eaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:39.922058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77118548-57de-4aef-b7e5-74074d785412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:39.988478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1358/2745] 10.222.0.49 () {58 vars in 967 bytes} [Mon Aug 1 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:40.030126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:40.031527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:40.123213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78205-e72a-4de0-a90f-e3e2e977d870 service nova] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:40.128186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e5baeab919f40e2b92f155a0c34d8d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:40.128798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:40.129076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:40.129344 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:40.138308 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:40.139872 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:40.148307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1388/2746] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Aug 1 14:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:44.537935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77118548-57de-4aef-b7e5-74074d785412 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:44.539453 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77118548-57de-4aef-b7e5-74074d785412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:44.611546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77118548-57de-4aef-b7e5-74074d785412 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:44.623927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:44.623927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:44.623927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:44.623927 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:44.624299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:44.631051 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:44.632625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:44.642622 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1359/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:48.218824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:48.220292 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:48.291856 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683db21-9d3f-4cc8-86bb-9c6e9bcd2e2d service swift] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:48.296359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:48.297037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:48.297323 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:48.297669 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] PATH_INFO: `/v3/users/0f18192b9dd241909b1957a7d43858c3` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:48.298904 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f18192b9dd241909b1957a7d43858c3)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:48.300836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:48.523922 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f18192b9dd241909b1957a7d43858c3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:48.524501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f18192b9dd241909b1957a7d43858c3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:48.537092 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f18192b9dd241909b1957a7d43858c3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:48.542474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:48.544613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f18192b9dd241909b1957a7d43858c3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:48.629695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f18192b9dd241909b1957a7d43858c3'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:48.636397 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1389/2748] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:48 2022] DELETE /identity/v3/users/0f18192b9dd241909b1957a7d43858c3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:48.871137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:48.881970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d255e-2c4f-43ef-b733-e83c12815893 service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:48.942226 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:48.942870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:48.943147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:48.943419 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] PATH_INFO: `/v3/projects/937e807649094f70844259eafaef26b1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:48.944558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937e807649094f70844259eafaef26b1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:48.946578 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:48.950781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:49.023407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937e807649094f70844259eafaef26b1', 'request_id': 'req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.029319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937e807649094f70844259eafaef26b1', 'request_id': 'req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.035338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937e807649094f70844259eafaef26b1', 'request_id': 'req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.085726 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] The token cache is being invalidate because project 937e807649094f70844259eafaef26b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:49.086054 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.086668 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.088714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1360/2749] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:48 2022] DELETE /identity/v3/projects/937e807649094f70844259eafaef26b1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:49.092667 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:49.094152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:49.107501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd055-75d1-4712-97cc-6f2020eed35f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:49.162897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:49.163466 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:49.163749 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:49.164024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] PATH_INFO: `/v3/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:49.165184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3f87dbd7a34e3fbfe89d2cfd9aa331)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:49.167801 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:49.368591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3f87dbd7a34e3fbfe89d2cfd9aa331'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.369276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3f87dbd7a34e3fbfe89d2cfd9aa331'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.381016 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3f87dbd7a34e3fbfe89d2cfd9aa331'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.388552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3f87dbd7a34e3fbfe89d2cfd9aa331'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.475362 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3f87dbd7a34e3fbfe89d2cfd9aa331'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.482147 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1390/2750] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:49 2022] DELETE /identity/v3/users/6a3f87dbd7a34e3fbfe89d2cfd9aa331 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:49.722451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:49.726872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:49.738101 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230cdd3-c8d4-40a2-b1c3-93bacdc57e14 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:49.800336 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:49.800982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:49.801262 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:49.801534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] PATH_INFO: `/v3/projects/742ef4197c4343d8897806a2e5a0a62a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:49.802703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=742ef4197c4343d8897806a2e5a0a62a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:49.804645 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:49.904604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742ef4197c4343d8897806a2e5a0a62a', 'request_id': 'req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.910069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742ef4197c4343d8897806a2e5a0a62a', 'request_id': 'req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.916913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742ef4197c4343d8897806a2e5a0a62a', 'request_id': 'req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.984136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] The token cache is being invalidate because project 742ef4197c4343d8897806a2e5a0a62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:49.984373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.984998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c42c89b0-a0d8-41a9-ab14-aa3d2141c0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:49.986561 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1361/2751] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:49 2022] DELETE /identity/v3/projects/742ef4197c4343d8897806a2e5a0a62a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:51.975720 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:51.977171 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:52.036107 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7de05-2a92-44dc-b4f6-4891ea58da59 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:52.056060 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:52.085182 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:52.085915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:52.086201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:52.086479 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:52.088743 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:52.148477 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:52.149947 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:52.159328 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1391/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:59.981160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:01.267575 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:01.268187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:01.268187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:01.287695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] MFA Rules not processed for user `cc8d9f649a43450da28c0f7c2e4515ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:01.288905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:01.295859 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1362/2753] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:02.252336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=37 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:05.174053 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:05.175568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:05.187198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee561-1330-4575-9e3b-27e05a4dcd23 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:05.191025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:05.191659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:05.191943 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:05.192229 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:05.194274 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:05.256706 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:05.258260 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:05.268201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1392/2754] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:11.282840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:15.263928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=28 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:21.647902 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:21.649412 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:21.707749 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3581-a871-412b-aeb3-94a2219dd7a1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:21.711754 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:21.712378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:21.712658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:21.712961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:21.714819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:21.785387 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:21.786852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:21.797898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1363/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:27.061991 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:27.063661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:27.144082 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b653807-ca14-40fe-b19f-437e6233c324 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:27.149306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:27.149993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:27.150279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:27.150592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:27.152321 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:27.164075 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:27.165645 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:27.175746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1393/2756] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:27.189885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:27.192121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:27.213550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d10f8-408e-4acc-9283-9d6748f714f0 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:27.219778 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:27.220434 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:27.220720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:27.220998 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] PATH_INFO: `/v3/users/fbb29845a13844f89fd004b401d27b8e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:27.222187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb29845a13844f89fd004b401d27b8e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:27.224192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:27.373952 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb29845a13844f89fd004b401d27b8e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.374613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb29845a13844f89fd004b401d27b8e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.386167 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb29845a13844f89fd004b401d27b8e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.386798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb29845a13844f89fd004b401d27b8e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.445942 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cebff431-5bb8-4a9e-8d58-788842130565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb29845a13844f89fd004b401d27b8e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.459013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1364/2757] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:27 2022] DELETE /identity/v3/users/fbb29845a13844f89fd004b401d27b8e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:27.705386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:27.716127 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c8fb-d7b0-4e2c-a5b8-d1cda71fdcd1 service placement] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:27.776369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:27.777012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:27.777299 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:27.777579 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] PATH_INFO: `/v3/projects/c6df4baf0a1242f2b73fe99071682355` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:27.778807 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6df4baf0a1242f2b73fe99071682355)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:27.781379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:27.892536 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6df4baf0a1242f2b73fe99071682355', 'request_id': 'req-86e1af77-7935-48cc-bc9c-db354ca61d8f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.898713 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6df4baf0a1242f2b73fe99071682355', 'request_id': 'req-86e1af77-7935-48cc-bc9c-db354ca61d8f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:27.904177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6df4baf0a1242f2b73fe99071682355', 'request_id': 'req-86e1af77-7935-48cc-bc9c-db354ca61d8f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:28.011571 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] The token cache is being invalidate because project c6df4baf0a1242f2b73fe99071682355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:28.011781 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:28.012390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-86e1af77-7935-48cc-bc9c-db354ca61d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:28.014591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1394/2758] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:27 2022] DELETE /identity/v3/projects/c6df4baf0a1242f2b73fe99071682355 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:28.019641 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.019937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.020251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.039628 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:28.040822 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:28.057451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:28.100467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1365/2759] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:33:28.109400 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.109994 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.110284 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.130732 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:28.131935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:28.141375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1395/2760] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:28.145537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.154442 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722f338-c344-449e-ab92-4f3f989cb173 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.159125 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.159729 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.160014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.160289 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.160980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:33:28.161282 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.162893 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.175533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1366/2761] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:33:28.179935 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.190165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c08a-5a03-46f1-9eb3-a634972df1ca None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.194782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.195379 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.195657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.195933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.196594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.198507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.209808 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:28.301654 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1396/2762] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:28.304887 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.316312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f0a3-d9b8-47f1-a299-73701c2b744b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.373086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.373701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.374016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.374297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.374951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.376929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.458139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1367/2763] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:28.462237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.473216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a8c27-e1c4-48de-b9b6-2d512817d7d6 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.477746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.478382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.478666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.478945 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.479666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.481257 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.491919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1397/2764] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:28.495790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.505903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ceef-8c98-4d99-a38d-c8c7178b5a8c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.510430 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.511033 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.511318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.511599 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.512286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.514735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2e55a-b112-4b0f-a60e-0f5e9f084c22 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.525217 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1368/2765] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:28.530022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.539937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcff099-923e-49a2-b5c4-47bc2b95c57c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.544456 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.545211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.545493 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.545804 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] PATH_INFO: `/v3/projects/1edb06768d904ba5a09a3f7e599a3256/users/ee0ebd421dba4035bc9db8b446b31ca6/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.560663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edb06768d904ba5a09a3f7e599a3256, user_id=ee0ebd421dba4035bc9db8b446b31ca6, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.563338 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.675120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1398/2766] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:28 2022] PUT /identity/v3/projects/1edb06768d904ba5a09a3f7e599a3256/users/ee0ebd421dba4035bc9db8b446b31ca6/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:28.686206 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.686500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.686780 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.716086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] MFA Rules not processed for user `ee0ebd421dba4035bc9db8b446b31ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:28.717521 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:28.782104 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1369/2767] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:28.786613 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.847954 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28c2dc-fc59-4d0d-92e3-f366be076285 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.852653 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:28.853269 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:28.853552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:28.853862 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:28.854527 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:28.856433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:28.945614 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1399/2768] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:28.949381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:28.960656 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bb7b6-6383-43b0-ba4b-8502413b6c05 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:28.973576 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:29.018782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.019405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.019687 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.019961 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.020619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.022699 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.132325 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1370/2769] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:28 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:29.136236 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.147611 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2d95-2e81-4ecb-8923-6e8dd60afd3e admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.152137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.152746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.153074 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.153347 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.155134 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.156731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.167415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1400/2770] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:29.172028 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.182117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bf0a0-615a-4092-86a1-7480dfa62588 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.186913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.187706 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.187997 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.188281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] PATH_INFO: `/v3/projects/8433a6a38bf740a4938dee864d5113e9/users/e3950397d23e4ea68a4a73c9801919e8/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.203727 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8433a6a38bf740a4938dee864d5113e9, user_id=e3950397d23e4ea68a4a73c9801919e8, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.206509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.287059 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1371/2771] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:29 2022] PUT /identity/v3/projects/8433a6a38bf740a4938dee864d5113e9/users/e3950397d23e4ea68a4a73c9801919e8/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:29.290976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.301348 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae1469-a00c-49a0-90ac-2a38280af881 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.357718 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.358761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.359047 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.359320 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.360011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.361977 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640cf6d-7e74-4a32-9b8b-12639d6170d2 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.371793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1401/2772] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:29.376407 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.386484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a76f-3f34-42d0-86fc-b5aa2265e5bb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.391307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.392002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.392308 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.392590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] PATH_INFO: `/v3/projects/8433a6a38bf740a4938dee864d5113e9/users/e3950397d23e4ea68a4a73c9801919e8/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.394620 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8433a6a38bf740a4938dee864d5113e9, user_id=e3950397d23e4ea68a4a73c9801919e8, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.397250 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.408156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1372/2773] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:29 2022] PUT /identity/v3/projects/8433a6a38bf740a4938dee864d5113e9/users/e3950397d23e4ea68a4a73c9801919e8/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:29.420605 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.420908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.421190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.448346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] MFA Rules not processed for user `e3950397d23e4ea68a4a73c9801919e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:29.449546 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:29.454908 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:29.516590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1402/2774] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:29.527933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.531276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:29.587070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4efc-e6db-4ea8-b76e-9b5d85efbd36 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.590715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.591865 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.592204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.592481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.601384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.602830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8e04-e684-4e6a-a062-780a56ae7799 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.613135 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1373/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:29.680797 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:29.743059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3799bb-a0f8-454a-ab3b-e3ad1ba813af None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:29.747761 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:29.748416 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:29.748698 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:29.748985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] PATH_INFO: `/v3/users/ee0ebd421dba4035bc9db8b446b31ca6` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:29.750232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0ebd421dba4035bc9db8b446b31ca6)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:29.752165 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:29.945069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0ebd421dba4035bc9db8b446b31ca6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:29.945661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0ebd421dba4035bc9db8b446b31ca6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:29.958264 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0ebd421dba4035bc9db8b446b31ca6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:29.964955 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0ebd421dba4035bc9db8b446b31ca6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.039245 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0ebd421dba4035bc9db8b446b31ca6'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.046135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1403/2776] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:29 2022] DELETE /identity/v3/users/ee0ebd421dba4035bc9db8b446b31ca6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:30.050782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:30.051068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:30.051346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:30.070056 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:30.071255 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:30.129049 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1374/2777] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:33:30.139046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:30.140501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:30.168537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:30.199708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcff2-4326-4bb8-95e6-a3a53cf5dce3 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:30.203415 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:30.204026 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:30.204304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:30.204573 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:30.213460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:30.215012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:30.225363 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1404/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:30.630393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:30.631905 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:30.646174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f74f2-9727-4c83-9b46-c6271b3868dc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:30.650885 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:30.651532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:30.651815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:30.652088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] PATH_INFO: `/v3/projects/1edb06768d904ba5a09a3f7e599a3256` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:30.653245 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1edb06768d904ba5a09a3f7e599a3256)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:30.656853 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:30.665160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:30.767654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edb06768d904ba5a09a3f7e599a3256', 'request_id': 'req-c226c180-7548-40e0-b246-ff9171cbf74b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.773230 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edb06768d904ba5a09a3f7e599a3256', 'request_id': 'req-c226c180-7548-40e0-b246-ff9171cbf74b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.781708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edb06768d904ba5a09a3f7e599a3256', 'request_id': 'req-c226c180-7548-40e0-b246-ff9171cbf74b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.846781 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] The token cache is being invalidate because project 1edb06768d904ba5a09a3f7e599a3256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:30.847072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.847715 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:30.849209 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1375/2779] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:30 2022] DELETE /identity/v3/projects/1edb06768d904ba5a09a3f7e599a3256 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:30.853131 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:30.864428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33916-d9c7-4ef3-8362-daba045a6d80 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:30.931132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:30.931787 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:30.932073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:30.932354 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] PATH_INFO: `/v3/users/e3950397d23e4ea68a4a73c9801919e8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:30.933515 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3950397d23e4ea68a4a73c9801919e8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:30.935487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:31.086553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3950397d23e4ea68a4a73c9801919e8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.087211 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3950397d23e4ea68a4a73c9801919e8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.099467 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3950397d23e4ea68a4a73c9801919e8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.106246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3950397d23e4ea68a4a73c9801919e8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.164877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-09a156e3-85c3-40cc-8e53-21a651f0f5fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3950397d23e4ea68a4a73c9801919e8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.172153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1405/2780] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:30 2022] DELETE /identity/v3/users/e3950397d23e4ea68a4a73c9801919e8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:31.659398 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:31.660852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:31.674590 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226c180-7548-40e0-b246-ff9171cbf74b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:31.734077 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:31.734725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:31.735008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:31.735286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] PATH_INFO: `/v3/projects/8433a6a38bf740a4938dee864d5113e9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:31.736751 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8433a6a38bf740a4938dee864d5113e9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:31.738692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:31.842406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8433a6a38bf740a4938dee864d5113e9', 'request_id': 'req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.848003 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8433a6a38bf740a4938dee864d5113e9', 'request_id': 'req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.854144 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8433a6a38bf740a4938dee864d5113e9', 'request_id': 'req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.908677 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] The token cache is being invalidate because project 8433a6a38bf740a4938dee864d5113e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:31.908898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.909519 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2bca1357-8ffb-4ee0-ae75-ed84e842ba80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:31.911008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1376/2781] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:31 2022] DELETE /identity/v3/projects/8433a6a38bf740a4938dee864d5113e9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:31.915903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:31.916190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:31.916462 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:31.937976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:31.939177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:31.979100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:31.998680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1406/2782] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:32.006432 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.011842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.011842 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.028454 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:32.030767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:32.038537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1377/2783] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:32.042786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.052577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cb884-da08-41e1-821b-f4eb64e0f193 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.057157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.057818 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.058105 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.058381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.059073 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:33:32.059375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.061101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.072310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1407/2784] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:33:32.077532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.086567 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9f4f-b3a1-4c4e-bea2-375b00f21261 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.091165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.092672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.092954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.093267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.093938 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.095819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.201536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:32.209066 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1378/2785] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:32.213403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.224404 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84795fc3-4844-42d4-9c6f-7b8da45c5db4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.283680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.284305 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.284591 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.284868 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.285557 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.287482 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.365722 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1408/2786] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:33:32.369971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.380672 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa797-66f1-4f58-a1cc-63346b56bed1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.386161 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.390763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.390763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.390763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.390763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.390763 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.400459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1379/2787] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:32.404677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.414659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7a0da-dac7-4ea0-be82-3ae74a824efc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.419358 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.420090 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.420427 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.420705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.421392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.423384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a97b7-c2eb-4f2c-b4ed-74fab12379a6 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.434322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1409/2788] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:32.439465 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.449118 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024e68-0599-42a2-8117-d9e28a96677e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.454819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.455405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.455684 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.455955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] PATH_INFO: `/v3/projects/3a377f6802e846108e631f8af6123467/users/70926d8e1a284768bff9900bd5df3ae8/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.470671 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a377f6802e846108e631f8af6123467, user_id=70926d8e1a284768bff9900bd5df3ae8, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.473378 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.537260 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1380/2789] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:32 2022] PUT /identity/v3/projects/3a377f6802e846108e631f8af6123467/users/70926d8e1a284768bff9900bd5df3ae8/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:32.548186 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.548495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.548753 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.577798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] MFA Rules not processed for user `70926d8e1a284768bff9900bd5df3ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:32.579022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:32.642896 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1410/2790] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:32.647484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.710042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f493c-635c-44e9-a409-29fedf218a14 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.714646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.715265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.715551 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.715830 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.717165 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.719081 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.802078 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1381/2791] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:32.806137 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.817255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08f95e-3700-42a1-a9f5-7e60159f29a3 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.857220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:32.875522 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.876143 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.876428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.876708 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.877377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.879332 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.967361 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1411/2792] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:32.970680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.981004 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92b6d-2ab5-470d-9070-7811affa1fc5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.986145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.987018 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.987399 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.987679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.988365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.989973 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:33.000550 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1382/2793] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:33:33.006487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:33.015498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e609-26a3-4777-8b72-d406af995f70 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:33.020193 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:33.020865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:33.021152 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:33.021428 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] PATH_INFO: `/v3/projects/00ecf132322f498582ddde69b83672d9/users/dfb7319a8da74134aaf106072f271f35/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:33.037052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ecf132322f498582ddde69b83672d9, user_id=dfb7319a8da74134aaf106072f271f35, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:33.039764 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:33.113376 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1412/2794] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:33 2022] PUT /identity/v3/projects/00ecf132322f498582ddde69b83672d9/users/dfb7319a8da74134aaf106072f271f35/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:33.117267 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:33.127695 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660f05d-528d-4e50-a5d9-0d2a4dc275a6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:33.183192 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:33.183811 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:33.184093 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:33.184369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:33.185625 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:33.187485 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b29ddf-1dda-4057-ac0f-e4262564c598 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:33.197142 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1383/2795] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:33.201923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:33.212116 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a3907-a906-4432-ba82-b8e97584be7b admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:33.216958 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:33.217657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:33.217928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:33.218207 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] PATH_INFO: `/v3/projects/00ecf132322f498582ddde69b83672d9/users/dfb7319a8da74134aaf106072f271f35/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:33.220149 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ecf132322f498582ddde69b83672d9, user_id=dfb7319a8da74134aaf106072f271f35, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:33.222877 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:33.233011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1413/2796] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:33 2022] PUT /identity/v3/projects/00ecf132322f498582ddde69b83672d9/users/dfb7319a8da74134aaf106072f271f35/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:33.298915 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:33.299205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:33.299488 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:33.328420 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] MFA Rules not processed for user `dfb7319a8da74134aaf106072f271f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:33.329613 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:33.349533 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:33.399145 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1384/2797] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:33.410004 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:33.411703 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:33.468683 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26395a-459e-4e75-8ab9-0bd219a04aeb admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:33.472501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:33.473141 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:33.473421 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:33.473695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:33.483504 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:33.484918 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644075-d2b4-426b-a2f7-c9e16da5ea4d service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:33.494488 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1414/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:34.575187 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:34.636143 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94be210-a366-40aa-87d8-f0ebdc9b7c7d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:34.641318 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:34.641984 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:34.642270 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:34.642548 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] PATH_INFO: `/v3/users/70926d8e1a284768bff9900bd5df3ae8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:34.643805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70926d8e1a284768bff9900bd5df3ae8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:34.645798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:34.820970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70926d8e1a284768bff9900bd5df3ae8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.821670 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70926d8e1a284768bff9900bd5df3ae8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.835017 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70926d8e1a284768bff9900bd5df3ae8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.835728 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70926d8e1a284768bff9900bd5df3ae8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.903396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70926d8e1a284768bff9900bd5df3ae8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.917738 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1385/2799] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:34 2022] DELETE /identity/v3/users/70926d8e1a284768bff9900bd5df3ae8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:34.923142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:34.923638 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:34.926382 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:34.949395 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:34.950750 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:35.012726 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1415/2800] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:35.022867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:35.024298 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:35.065287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:35.085795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d056-0450-4d54-9bc5-a26aa0a655bd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:35.085795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:35.085795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:35.085795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:35.086416 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:35.096198 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:35.097762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:35.108207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1386/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:33:35.500109 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:35.502056 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:35.518341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de054-ba78-48d5-9128-fb741b2a27ac None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:35.523228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:35.523884 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:35.524164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:35.524442 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] PATH_INFO: `/v3/projects/3a377f6802e846108e631f8af6123467` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:35.525660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a377f6802e846108e631f8af6123467)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:35.527617 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:35.600117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:35.613429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a377f6802e846108e631f8af6123467', 'request_id': 'req-c440c77e-4718-44fd-b042-96bd07b6d17f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.619684 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a377f6802e846108e631f8af6123467', 'request_id': 'req-c440c77e-4718-44fd-b042-96bd07b6d17f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.625919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a377f6802e846108e631f8af6123467', 'request_id': 'req-c440c77e-4718-44fd-b042-96bd07b6d17f'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.691471 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] The token cache is being invalidate because project 3a377f6802e846108e631f8af6123467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:35.691746 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.692368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.694023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1416/2802] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:35 2022] DELETE /identity/v3/projects/3a377f6802e846108e631f8af6123467 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:35.697994 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:35.708128 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5393b-a33e-4b9b-8516-9f31c5cbc3f0 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:35.764837 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:35.765207 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:35.765486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:35.765783 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] PATH_INFO: `/v3/users/dfb7319a8da74134aaf106072f271f35` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:35.767166 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb7319a8da74134aaf106072f271f35)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:35.769115 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:35.950291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb7319a8da74134aaf106072f271f35'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.952052 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb7319a8da74134aaf106072f271f35'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.964107 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb7319a8da74134aaf106072f271f35'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:35.964736 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb7319a8da74134aaf106072f271f35'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.015720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b8a4c12-e6d7-419b-9f6b-4fe4ef451259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb7319a8da74134aaf106072f271f35'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.028026 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1387/2803] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:35 2022] DELETE /identity/v3/users/dfb7319a8da74134aaf106072f271f35 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:36.423879 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:36.425433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:36.440115 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c77e-4718-44fd-b042-96bd07b6d17f admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:36.497256 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:36.498887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:36.499209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:36.499484 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] PATH_INFO: `/v3/projects/00ecf132322f498582ddde69b83672d9` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:36.500665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ecf132322f498582ddde69b83672d9)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:36.502598 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:36.593549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ecf132322f498582ddde69b83672d9', 'request_id': 'req-b4234d57-30a5-44fa-9814-f0a6f4df640e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.599537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ecf132322f498582ddde69b83672d9', 'request_id': 'req-b4234d57-30a5-44fa-9814-f0a6f4df640e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.604923 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ecf132322f498582ddde69b83672d9', 'request_id': 'req-b4234d57-30a5-44fa-9814-f0a6f4df640e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.678932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] The token cache is being invalidate because project 00ecf132322f498582ddde69b83672d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:36.679222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.679925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4234d57-30a5-44fa-9814-f0a6f4df640e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:36.681501 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1417/2804] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:36 2022] DELETE /identity/v3/projects/00ecf132322f498582ddde69b83672d9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:33:36.686463 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:36.686750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:36.687025 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:36.709012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:36.710393 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:36.766826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:36.775189 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1388/2805] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:36.783838 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:36.784132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:36.784419 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:36.804528 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:36.805773 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:36.814728 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1418/2806] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:36.819065 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:36.829532 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b37c4-a3bb-4009-b63b-af1c26ed9118 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:36.834117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:36.834721 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:36.835005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:36.835281 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:36.835971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:33:36.836279 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:36.837888 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:36.849297 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1389/2807] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:33:36.853538 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:36.863430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b9e36-8aaa-4917-ba13-5d6c5b2add5c None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:36.869405 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:36.870064 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:36.870350 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:36.870627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:36.871293 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:36.874029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:36.973905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1419/2808] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:36 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:36.978058 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:36.988608 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302128-dad8-4a5d-b09a-a43db85411ff admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:37.048546 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:37.049186 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.049471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.049766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.050444 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:37.052476 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:37.131935 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1390/2809] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:36 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:37.136285 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:37.147699 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e331-803f-4c52-8e81-39490ad52139 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:37.152360 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:37.152964 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.153246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.153521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.154335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:37.155951 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:37.165852 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1420/2810] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:37.170795 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:37.181088 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485839-47b1-48f4-8174-f9250624cbc9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:37.186446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:37.187591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.187873 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.188147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.188917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:37.190547 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c60e9-eb7b-4ce3-8c69-6f4095bbee69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:37.203072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1391/2811] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:37.206709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:37.217392 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3da719-8aef-43f5-abce-63608569287a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:37.222374 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:37.223102 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.223375 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.223650 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] PATH_INFO: `/v3/projects/a3521104c0c243bda151fc972fc792fd/users/c30ed7daf74c439ca5abdeaa75f8d10b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.226914 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:37.239458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3521104c0c243bda151fc972fc792fd, user_id=c30ed7daf74c439ca5abdeaa75f8d10b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:37.242286 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:37.310934 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1421/2812] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:37 2022] PUT /identity/v3/projects/a3521104c0c243bda151fc972fc792fd/users/c30ed7daf74c439ca5abdeaa75f8d10b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:37.316527 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bce73-fbef-43ad-97c9-f9c5fc97e434 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.316882 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bce73-fbef-43ad-97c9-f9c5fc97e434 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.317219 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bce73-fbef-43ad-97c9-f9c5fc97e434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.337557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-260bce73-fbef-43ad-97c9-f9c5fc97e434 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:37.338835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-260bce73-fbef-43ad-97c9-f9c5fc97e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:37.402306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1392/2813] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:37.413301 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:37.415049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:37.472327 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe49571-a396-408f-a93f-f3d6f1804ec9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:37.476013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:37.476633 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:37.476982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:37.477190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:37.488365 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:37.489834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:37.500122 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1422/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:38.732044 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:38.732892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:38.732892 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:38.766919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] MFA Rules not processed for user `c30ed7daf74c439ca5abdeaa75f8d10b`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:38.768160 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:38.827199 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:38.838509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1393/2815] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:38.843932 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:38.855195 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd325-e555-43b3-b74d-088427dc607b service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:38.860251 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:38.860865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:38.861153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:38.861734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:38.862470 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:38.864453 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:38.979049 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1423/2816] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:33:38 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:38.983147 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:38.994373 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72482f-5c48-43e3-9a3c-15eff1e2ff6d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:39.051005 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:39.051623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:39.051904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:39.052180 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:39.052840 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:39.054777 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:39.189731 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1394/2817] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:33:38 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:33:39.193619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:39.204649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd5e91-6542-4460-8a59-0854672bdbe8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:39.209089 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:39.209687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:39.210132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:39.210412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:39.211099 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:39.212680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:39.223867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1424/2818] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:39.228413 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:39.239801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498254e-a0a8-4a22-bec6-b8db1f387fc3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:39.244491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:39.245150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:39.245431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:39.245704 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] PATH_INFO: `/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5/users/97660af326ed4ab1b1a5fe8f4cde9d7f/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:39.260643 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99f534e8dbc44cf9d5b235fbbfe28a5, user_id=97660af326ed4ab1b1a5fe8f4cde9d7f, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:39.263356 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:39.330556 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1395/2819] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:39 2022] PUT /identity/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5/users/97660af326ed4ab1b1a5fe8f4cde9d7f/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:39.334615 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:39.344829 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d488b0d-3be8-46d2-9b23-c2d8efda85f4 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:39.400135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:39.400739 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:39.401019 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:39.401288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:39.401989 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:39.403562 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15244d-0dc0-47e7-82a3-a3a2e527ce94 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:39.413255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1425/2820] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:33:39.417574 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:39.428491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c0d9f-baba-4bf6-97b3-1196fbf34355 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:39.433156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:39.433852 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:39.434139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:39.434418 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] PATH_INFO: `/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5/users/97660af326ed4ab1b1a5fe8f4cde9d7f/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:39.437032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99f534e8dbc44cf9d5b235fbbfe28a5, user_id=97660af326ed4ab1b1a5fe8f4cde9d7f, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:39.439692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:39.449612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1396/2821] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:33:39 2022] PUT /identity/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5/users/97660af326ed4ab1b1a5fe8f4cde9d7f/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:40.625832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:40.626433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:40.626433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:40.654975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] MFA Rules not processed for user `97660af326ed4ab1b1a5fe8f4cde9d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:40.656214 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:40.698342 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:40.727383 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1426/2822] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:33:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:33:40.739352 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:40.741190 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:40.806290 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64be0-4b9c-4e6f-af67-e1c78ca49df8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:40.809970 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:40.811236 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:40.811523 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:40.811803 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:40.870872 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:40.872296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:40.881982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1397/2823] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:42.643014 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:42.644432 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:42.656786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d563d-b796-4457-acf8-1e7d64362f8b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:42.660369 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:42.660985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:42.661267 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:42.661545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:42.670478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:42.672463 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:42.681911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1427/2824] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:50.877977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:52.677648 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=17 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:58.492907 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:58.554396 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed9fa9-d962-4e45-baab-37a76eabcc9a service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:58.558889 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:58.559520 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:58.559798 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:58.560070 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] PATH_INFO: `/v3/users/c30ed7daf74c439ca5abdeaa75f8d10b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:58.561220 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30ed7daf74c439ca5abdeaa75f8d10b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:58.563150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:58.756592 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30ed7daf74c439ca5abdeaa75f8d10b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:58.757178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30ed7daf74c439ca5abdeaa75f8d10b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:58.769926 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30ed7daf74c439ca5abdeaa75f8d10b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:58.770612 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30ed7daf74c439ca5abdeaa75f8d10b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:58.839555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30ed7daf74c439ca5abdeaa75f8d10b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:58.852421 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1398/2825] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:58 2022] DELETE /identity/v3/users/c30ed7daf74c439ca5abdeaa75f8d10b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:59.087023 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:59.098343 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d3a1-cfd7-4ddb-85a0-9937a6c61d90 service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:59.156359 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:59.157001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:59.157279 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:59.157551 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] PATH_INFO: `/v3/projects/a3521104c0c243bda151fc972fc792fd` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:59.159508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3521104c0c243bda151fc972fc792fd)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:59.161386 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:59.246398 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3521104c0c243bda151fc972fc792fd', 'request_id': 'req-a3d70479-acdd-4d0d-ae24-8dc75efc3440'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.252812 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3521104c0c243bda151fc972fc792fd', 'request_id': 'req-a3d70479-acdd-4d0d-ae24-8dc75efc3440'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.258510 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3521104c0c243bda151fc972fc792fd', 'request_id': 'req-a3d70479-acdd-4d0d-ae24-8dc75efc3440'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.313221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] The token cache is being invalidate because project a3521104c0c243bda151fc972fc792fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:59.313508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.314153 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.315986 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1428/2826] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:59 2022] DELETE /identity/v3/projects/a3521104c0c243bda151fc972fc792fd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:59.320150 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:59.321559 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:59.334977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32be315-7660-4488-820a-eab443234d58 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:59.390200 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:59.390835 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:59.391116 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:59.391390 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] PATH_INFO: `/v3/users/97660af326ed4ab1b1a5fe8f4cde9d7f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:59.392545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97660af326ed4ab1b1a5fe8f4cde9d7f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:59.394484 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:59.416474 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:59.598112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97660af326ed4ab1b1a5fe8f4cde9d7f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.598814 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97660af326ed4ab1b1a5fe8f4cde9d7f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.610471 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97660af326ed4ab1b1a5fe8f4cde9d7f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.611395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97660af326ed4ab1b1a5fe8f4cde9d7f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.685237 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ba7ec7af-88c2-48f2-b2e1-6a302076d352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97660af326ed4ab1b1a5fe8f4cde9d7f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:59.697846 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1399/2827] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:59 2022] DELETE /identity/v3/users/97660af326ed4ab1b1a5fe8f4cde9d7f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:59.965530 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:59.967135 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:59.980322 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d70479-acdd-4d0d-ae24-8dc75efc3440 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.041475 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.042177 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.042465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.042745 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] PATH_INFO: `/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.043931 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99f534e8dbc44cf9d5b235fbbfe28a5)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.045929 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.154447 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:00.166521 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99f534e8dbc44cf9d5b235fbbfe28a5', 'request_id': 'req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:00.172495 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99f534e8dbc44cf9d5b235fbbfe28a5', 'request_id': 'req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:00.178836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99f534e8dbc44cf9d5b235fbbfe28a5', 'request_id': 'req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:00.267649 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] The token cache is being invalidate because project e99f534e8dbc44cf9d5b235fbbfe28a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:00.273184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:00.273184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-712952b2-ec91-4e2d-89bc-bc4a15f71ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:00.273184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1429/2828] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:59 2022] DELETE /identity/v3/projects/e99f534e8dbc44cf9d5b235fbbfe28a5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:00.274982 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.275277 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.275558 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.295734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:00.297038 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:00.356503 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1400/2829] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:00.364695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.364985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.365265 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.384454 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:00.385641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:00.394096 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1430/2830] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:00.398178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.407772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2af9c-893f-443a-8cdf-d48f1d52589c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.413203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.413844 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.414127 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.414405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.415085 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:34:00.415385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.416951 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.428426 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1401/2831] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:34:00.432446 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.441553 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc0f5-e183-48de-a93e-379391f235e4 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.446126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.446723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.447003 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.447276 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.447928 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.449839 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.538843 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1431/2832] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:00.543053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.553109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c80a9-8a1c-47c3-acc5-d1cff96f5d2b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.607954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.608627 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.608841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.609136 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.609801 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.612069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.673544 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1402/2833] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:00.677765 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.688132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcaf2-a0b7-4a4f-9e95-852013c74b3d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.693183 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.693817 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.694104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.694380 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.695077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.696660 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.707389 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1432/2834] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:00.711347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.721348 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732cf87-429d-4267-86ef-2e0fb9a6c296 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.726002 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.726604 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.726891 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.727170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.727864 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.729438 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0cdf3-222c-48cc-90ab-b98fc4b5eeac admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.740168 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1403/2835] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:34:00.744391 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:00.755093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84739-a705-4550-8bef-7dddff5fa627 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:00.759792 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:00.760450 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.760729 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.761005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] PATH_INFO: `/v3/projects/6a7629e440424f4f8ccae74f5c8f56bf/users/e7d92ba0e42643de8dd5a55f2032e02b/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.777095 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7629e440424f4f8ccae74f5c8f56bf, user_id=e7d92ba0e42643de8dd5a55f2032e02b, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:00.780198 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:00.851304 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1433/2836] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:00 2022] PUT /identity/v3/projects/6a7629e440424f4f8ccae74f5c8f56bf/users/e7d92ba0e42643de8dd5a55f2032e02b/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:34:00.871149 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:00.871439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:00.871719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:00.880365 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:00.900218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] MFA Rules not processed for user `e7d92ba0e42643de8dd5a55f2032e02b`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:00.901470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:00.967557 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1404/2837] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:00.972009 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.032836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9590a-0f6f-48d2-8734-e15341cc18f0 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.037663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.038309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.038602 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.038883 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.039545 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.041448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.126169 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1434/2838] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:00 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:01.131099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.142121 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a727bb-f9a9-4aeb-b0ea-4d8ddb5f16e6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.200170 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.201228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.201826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.202338 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.203586 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.207860 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.302939 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1405/2839] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:01 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:01.312581 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.323216 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ae7-81c8-452b-a3a5-65335c386a09 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.327901 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.328509 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.328794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.329077 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.329798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.332000 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.342584 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1435/2840] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:01.347607 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.357597 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d12bed-d57a-48e4-bdbb-5beebe502703 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.362883 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.363536 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.363817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.364095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] PATH_INFO: `/v3/projects/3dd47ef2201f4c6fbc16c689708c2515/users/0b0259f1b4e041aa985c7712b65b2172/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.378583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd47ef2201f4c6fbc16c689708c2515, user_id=0b0259f1b4e041aa985c7712b65b2172, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.381218 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.457649 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1406/2841] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:01 2022] PUT /identity/v3/projects/3dd47ef2201f4c6fbc16c689708c2515/users/0b0259f1b4e041aa985c7712b65b2172/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:01.461647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.471796 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001809f-08e8-4f7c-ad03-70ce7a73f8cd admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.500101 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:01.528505 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.529126 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.529445 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.529966 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.530861 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.532984 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774acd9-944f-4522-ad2b-5fc21253a30a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.543341 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1436/2842] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:01.547511 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.558669 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7665-96f6-4f56-8c8f-900d20c6b134 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.563249 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.564138 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.564894 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.565268 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] PATH_INFO: `/v3/projects/3dd47ef2201f4c6fbc16c689708c2515/users/0b0259f1b4e041aa985c7712b65b2172/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.567337 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd47ef2201f4c6fbc16c689708c2515, user_id=0b0259f1b4e041aa985c7712b65b2172, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.569989 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.580692 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1407/2843] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:01 2022] PUT /identity/v3/projects/3dd47ef2201f4c6fbc16c689708c2515/users/0b0259f1b4e041aa985c7712b65b2172/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:01.590716 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.592711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.592711 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.619744 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] MFA Rules not processed for user `0b0259f1b4e041aa985c7712b65b2172`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:01.620973 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:01.690439 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1437/2844] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:34:01.701385 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:01.703216 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:01.755708 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:01.761117 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f356-38e2-455b-8e7c-8c9a85207b5f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:01.770299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:01.770299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:01.770299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:01.770299 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:01.823589 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:01.825036 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce768e3-503b-4190-a525-6163d94b963f service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:01.834784 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1408/2845] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:04.830508 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:04.892011 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fbdf-1810-4fb9-94e0-e1a2b3d8dc7d None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:04.897123 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:04.897772 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:04.898063 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:04.898336 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] PATH_INFO: `/v3/users/e7d92ba0e42643de8dd5a55f2032e02b` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:04.899485 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d92ba0e42643de8dd5a55f2032e02b)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:04.901402 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:05.058520 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d92ba0e42643de8dd5a55f2032e02b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.059100 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d92ba0e42643de8dd5a55f2032e02b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.064289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:05.070982 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d92ba0e42643de8dd5a55f2032e02b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.077691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d92ba0e42643de8dd5a55f2032e02b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.152723 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d92ba0e42643de8dd5a55f2032e02b'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.159675 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1438/2846] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:04 2022] DELETE /identity/v3/users/e7d92ba0e42643de8dd5a55f2032e02b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:05.164361 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:05.164839 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:05.164971 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:05.183626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:05.184836 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:05.242347 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1409/2847] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:05.254120 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:05.255701 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:05.312483 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913323-bce0-4e05-af17-54619113a2f8 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:05.316997 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:05.317609 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:05.317925 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:05.318204 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:05.327117 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:05.328535 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:05.338552 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1439/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:05.709833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:05.711335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:05.723817 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0b48-4d5c-4ecc-9740-614bf3f49bb5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:05.728977 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:05.729626 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:05.729954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:05.730228 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] PATH_INFO: `/v3/projects/6a7629e440424f4f8ccae74f5c8f56bf` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:05.731384 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7629e440424f4f8ccae74f5c8f56bf)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:05.733408 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:05.823685 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7629e440424f4f8ccae74f5c8f56bf', 'request_id': 'req-f91cf20f-74e9-48d8-b602-8e61dd9c4230'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.829470 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7629e440424f4f8ccae74f5c8f56bf', 'request_id': 'req-f91cf20f-74e9-48d8-b602-8e61dd9c4230'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.836327 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7629e440424f4f8ccae74f5c8f56bf', 'request_id': 'req-f91cf20f-74e9-48d8-b602-8e61dd9c4230'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.896194 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] The token cache is being invalidate because project 6a7629e440424f4f8ccae74f5c8f56bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:05.896486 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.897103 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:05.898772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1410/2849] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:05 2022] DELETE /identity/v3/projects/6a7629e440424f4f8ccae74f5c8f56bf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:05.902793 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:05.913433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccf19e-5108-4156-9085-df0b65a6f902 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:05.970232 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:05.971588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:05.971867 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:05.972142 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] PATH_INFO: `/v3/users/0b0259f1b4e041aa985c7712b65b2172` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:05.973314 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0259f1b4e041aa985c7712b65b2172)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:05.975268 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:06.202458 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0259f1b4e041aa985c7712b65b2172'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.203040 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0259f1b4e041aa985c7712b65b2172'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.215001 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0259f1b4e041aa985c7712b65b2172'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.222540 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0259f1b4e041aa985c7712b65b2172'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.225167 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:06.325357 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-2201f7e6-fb14-4714-8339-f5a69e7cbe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0259f1b4e041aa985c7712b65b2172'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.332577 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1440/2850] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:05 2022] DELETE /identity/v3/users/0b0259f1b4e041aa985c7712b65b2172 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:06.755934 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:06.757447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:06.771815 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cf20f-74e9-48d8-b602-8e61dd9c4230 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:06.792820 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:06.828722 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:06.829491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:06.829696 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:06.830651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] PATH_INFO: `/v3/projects/3dd47ef2201f4c6fbc16c689708c2515` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:06.832195 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd47ef2201f4c6fbc16c689708c2515)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:06.834133 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:06.948682 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd47ef2201f4c6fbc16c689708c2515', 'request_id': 'req-450f3214-6947-437d-b466-5b90c5d8b756'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.954491 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd47ef2201f4c6fbc16c689708c2515', 'request_id': 'req-450f3214-6947-437d-b466-5b90c5d8b756'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:06.961340 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd47ef2201f4c6fbc16c689708c2515', 'request_id': 'req-450f3214-6947-437d-b466-5b90c5d8b756'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:07.062114 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] The token cache is being invalidate because project 3dd47ef2201f4c6fbc16c689708c2515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:07.062319 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:07.062954 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-450f3214-6947-437d-b466-5b90c5d8b756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:07.065095 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1411/2851] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:06 2022] DELETE /identity/v3/projects/3dd47ef2201f4c6fbc16c689708c2515 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:07.070388 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.070876 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.070985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.090429 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:07.091634 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.150460 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1441/2852] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:07.158381 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.158719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.159027 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.179264 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:07.180459 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.188275 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1412/2853] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:07.193113 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.202842 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf19e-1b3c-474e-8b77-191e20adc110 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.207664 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.208266 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.208549 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.208824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.209519 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:34:07.209905 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.211499 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.223897 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1442/2854] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:34:07.228203 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.239129 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb304-f073-4559-a9cb-1ae329f730bf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.243833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.244468 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.244750 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.245024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.245679 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.247583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.384870 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1413/2855] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:07 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:07.389139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.399288 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809999e-e4fa-4161-8410-3efb0e8ed0c9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.454758 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.455659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.455946 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.456221 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] PATH_INFO: `/v3/users` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.456874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.458816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.565568 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1443/2856] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:07 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:07.569826 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.580494 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815c7c-c4eb-4962-b594-4a7dc25e26c6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.585007 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.590379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.590379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.590379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.590379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.590379 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.599368 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1414/2857] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:07.603368 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.614574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e7b8-6e2c-4452-bbf4-005c96166487 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.619125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.619721 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.620005 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.620282 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.620962 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.622632 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b254a2-f444-4092-9759-03023889e5e8 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.633377 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1444/2858] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:07.637395 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.647274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c384b-d5b6-4888-9487-8572589ec9db admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.651916 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.652572 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.652857 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.653137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] PATH_INFO: `/v3/projects/e1c58321667c42bd8cef7de125f2dab0/users/e54c1a4867d74ec2a3430b00e19f3c95/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.668813 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c58321667c42bd8cef7de125f2dab0, user_id=e54c1a4867d74ec2a3430b00e19f3c95, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.671480 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.752702 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1415/2859] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:07 2022] PUT /identity/v3/projects/e1c58321667c42bd8cef7de125f2dab0/users/e54c1a4867d74ec2a3430b00e19f3c95/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:07.764281 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.764409 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.764627 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.793417 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] MFA Rules not processed for user `e54c1a4867d74ec2a3430b00e19f3c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:07.794644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.841025 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:07.858993 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1445/2860] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:07.870287 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.872102 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.930406 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154493f6-491e-4ad0-b258-665a747cd82b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.934012 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.934634 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.934913 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.935185 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.941139 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:07.944697 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.946148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.954767 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1416/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:17.993607 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=5 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:18.279411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:31.000666 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:31.002076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:31.072791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccf937-0bb7-40fa-935b-4c65bac7657e None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:31.077782 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:31.078403 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:31.078680 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:31.078952 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:31.080665 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:31.092590 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:31.094192 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fa746-1f5e-4bd7-bee5-9a71df1d48d8 service placement] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:31.105919 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1446/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:32.028745 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:32.089179 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d56547-0560-4cb7-867e-15e7f598a057 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:32.093709 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:32.094369 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:32.094652 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:32.094928 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] PATH_INFO: `/v3/users/e54c1a4867d74ec2a3430b00e19f3c95` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:32.096069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54c1a4867d74ec2a3430b00e19f3c95)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:32.098016 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:32.338714 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54c1a4867d74ec2a3430b00e19f3c95'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:32.339391 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54c1a4867d74ec2a3430b00e19f3c95'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:32.352113 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54c1a4867d74ec2a3430b00e19f3c95'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:32.357545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54c1a4867d74ec2a3430b00e19f3c95'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:32.433109 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54c1a4867d74ec2a3430b00e19f3c95'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:32.446053 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1417/2863] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:32 2022] DELETE /identity/v3/users/e54c1a4867d74ec2a3430b00e19f3c95 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:32.450670 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:32.451162 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:32.451277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:32.471087 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:32.472287 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:32.533118 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1447/2864] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:32.543774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:32.545176 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:32.601301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe4602-981c-4878-b713-cfb5b7441dde admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:32.604962 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:32.605587 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:32.605901 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:32.606174 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:32.616301 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:32.617719 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629ae5-3925-4abc-ad63-ea502d6f5e9a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:32.627196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1418/2865] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:33.005298 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.007237 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:33.019734 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bd10e-a276-44c6-9206-ec44f7dc0e50 None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.025384 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.026076 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.026465 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.026687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] PATH_INFO: `/v3/projects/e1c58321667c42bd8cef7de125f2dab0` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.027885 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c58321667c42bd8cef7de125f2dab0)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.029921 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.147798 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c58321667c42bd8cef7de125f2dab0', 'request_id': 'req-57273f6b-03e3-4a16-825d-11835ffde7f1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:33.153864 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c58321667c42bd8cef7de125f2dab0', 'request_id': 'req-57273f6b-03e3-4a16-825d-11835ffde7f1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:33.159474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c58321667c42bd8cef7de125f2dab0', 'request_id': 'req-57273f6b-03e3-4a16-825d-11835ffde7f1'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:33.242756 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] The token cache is being invalidate because project e1c58321667c42bd8cef7de125f2dab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:33.243048 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:33.243794 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-57273f6b-03e3-4a16-825d-11835ffde7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:33.245309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1448/2866] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:33 2022] DELETE /identity/v3/projects/e1c58321667c42bd8cef7de125f2dab0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:33.250254 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.251392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.251392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.270479 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:33.275792 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:33.288545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:33.329980 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1419/2867] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:33.338588 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.338874 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.339151 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.359046 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:33.362663 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:33.368594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1449/2868] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:33.372680 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.382686 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40d1a3-8a52-4ae7-a95e-332e768de326 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.387720 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.388330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.388618 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.388898 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.389593 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:34:33.389937 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.391555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.403563 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1420/2869] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Aug 1 14:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:34:33.407560 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.417671 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabdbc6-b713-4410-a9f7-39767d9c9a1b None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.422277 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.422878 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.423157 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.423430 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.424088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.425999 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.430594 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:33.539396 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1450/2870] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:33 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:33.543508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.553735 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d7608-ce9c-47fe-ad4c-76b5839854a5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.618446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.619068 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.619357 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.619636 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.620307 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.622257 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.719013 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1421/2871] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:33 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:33.723802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.734190 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376638e4-dd8e-4488-8aa2-c9fdede6044d admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.740030 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.740687 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.740971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.741246 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.741975 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.743600 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.753335 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1451/2872] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:33.757582 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.767716 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1c78-b7b6-4f40-939e-4b677801c20c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.773067 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.773664 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.773975 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.774251 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.774967 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.776841 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932587-322f-42a9-9ffd-bb3b273da165 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.788196 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1422/2873] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:33.792370 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:33.803309 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0d5c-ab69-4045-8012-c248966cce6c admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:33.807858 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:33.808507 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.808791 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.809067 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] PATH_INFO: `/v3/projects/096f190596204bf6b90d62d5f6796536/users/cf2c4a7396994dda943290653aa1abd8/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.823547 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096f190596204bf6b90d62d5f6796536, user_id=cf2c4a7396994dda943290653aa1abd8, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:33.826220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:33.890261 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1452/2874] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:33 2022] PUT /identity/v3/projects/096f190596204bf6b90d62d5f6796536/users/cf2c4a7396994dda943290653aa1abd8/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:33.914164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:33.914475 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:33.914774 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:33.942502 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] MFA Rules not processed for user `cf2c4a7396994dda943290653aa1abd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:33.943701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:34.008330 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1423/2875] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:34.012709 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.074970 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa1b0-284f-4c2e-8816-f1f813c68461 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.079886 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.080491 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.080775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.081051 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.081719 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.084619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.200220 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1453/2876] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:34 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:34.204294 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.215610 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a48c0-e709-40be-82e9-7abcc785324e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.228300 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:34.272790 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.273489 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.273646 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.273955 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.274619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.276535 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.354326 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1424/2877] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:34 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:34.363847 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.374291 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c5186-a83d-4967-b54d-5947052e48e9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.379069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.380307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.380693 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.380971 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.381691 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.383331 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.393802 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1454/2878] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:34.398313 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.408360 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab908c8d-a7b4-4c58-887f-3fc9e1f52e9f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.413621 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.414261 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.414542 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.414816 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.415500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.417072 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80b101-1d83-4d4c-bd9e-d7cdaf1b8a53 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.427531 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1425/2879] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:34.431390 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.441254 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1010e-4b20-406b-b177-8f810c5aac30 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.446960 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.447619 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.447907 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.448188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] PATH_INFO: `/v3/projects/c0e74f933ea54bc5a42a328fc2ebeb8a/users/2cb2f4780a2a499bbb04d64526f2fc84/roles/e9a1c6082491409eae9864b0d1b03f13` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.463662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e74f933ea54bc5a42a328fc2ebeb8a, user_id=2cb2f4780a2a499bbb04d64526f2fc84, role_id=e9a1c6082491409eae9864b0d1b03f13)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.466655 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.541731 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1455/2880] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:34 2022] PUT /identity/v3/projects/c0e74f933ea54bc5a42a328fc2ebeb8a/users/2cb2f4780a2a499bbb04d64526f2fc84/roles/e9a1c6082491409eae9864b0d1b03f13 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:34.551917 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.552208 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.553178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.581725 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] MFA Rules not processed for user `2cb2f4780a2a499bbb04d64526f2fc84`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:34.583838 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:34.646765 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1426/2881] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:34.651213 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.712222 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0364794-2322-462f-b5d7-3130121e37d9 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.716865 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.717478 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.717771 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.718069 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.718727 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.720647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.725832 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:34.841451 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1456/2882] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Aug 1 14:34:34 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:34.845306 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:34.856761 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b67501-0378-4417-8d60-1a2e2d59814e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:34.912447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:34.913062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:34.913346 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:34.913623 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:34.914311 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:34.916213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:34.998929 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1427/2883] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Aug 1 14:34:34 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:34:35.002985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:35.013472 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4c73-2922-4804-8a1d-17277fac1c10 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:35.018104 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:35.018707 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.019052 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.019247 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.020437 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:35.022130 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:35.031903 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1457/2884] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:35.036514 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:35.046583 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e4a3e-b823-4721-b5df-3eb13ac927ca admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:35.051371 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:35.052032 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.052320 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.052602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] PATH_INFO: `/v3/projects/54cbf12c82cd431aa7683541ba4fac02/users/d3fe2185d3354b0e9b78ce61318d4800/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.064611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:35.067717 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cbf12c82cd431aa7683541ba4fac02, user_id=d3fe2185d3354b0e9b78ce61318d4800, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:35.070478 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:35.147903 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1428/2885] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:35 2022] PUT /identity/v3/projects/54cbf12c82cd431aa7683541ba4fac02/users/d3fe2185d3354b0e9b78ce61318d4800/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:34:35.151824 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:35.162191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c452-d38f-4bb7-81eb-b00d07e61787 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:35.221070 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:35.221710 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.222029 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.222306 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.222995 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:35.224662 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447640-a6c4-4c48-a6bc-32caa73bf82c admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:35.234704 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1458/2886] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Aug 1 14:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:34:35.239380 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:35.249615 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180f2c-948f-4d19-9dcf-de30090e01b7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:35.255000 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:35.255711 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.255992 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.256271 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] PATH_INFO: `/v3/projects/54cbf12c82cd431aa7683541ba4fac02/users/d3fe2185d3354b0e9b78ce61318d4800/roles/1c201ebfc669434982f999e02a45c09f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.258246 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cbf12c82cd431aa7683541ba4fac02, user_id=d3fe2185d3354b0e9b78ce61318d4800, role_id=1c201ebfc669434982f999e02a45c09f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:35.260886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:35.271654 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1429/2887] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Aug 1 14:34:35 2022] PUT /identity/v3/projects/54cbf12c82cd431aa7683541ba4fac02/users/d3fe2185d3354b0e9b78ce61318d4800/roles/1c201ebfc669434982f999e02a45c09f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:35.281891 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] REQUEST_METHOD: `POST` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.282209 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.282487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.309915 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.auth.core [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] MFA Rules not processed for user `d3fe2185d3354b0e9b78ce61318d4800`. Rule list: `[]` (Enabled: `True`). {{(pid=80459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:35.311125 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:35.377855 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1459/2888] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:35.389904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:35.391577 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:35.447439 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093584-5d98-4f61-b75c-71daeec08726 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:35.450933 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:35.451555 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:35.451818 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:35.452092 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:35.506591 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:35.508042 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:35.516693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1430/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:37.485150 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:37.487024 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:37.499672 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aebb27-72aa-462d-b219-85e39f8560cf None None] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:37.503258 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:37.503887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:37.504176 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:37.504468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:37.557537 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:37.561139 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:37.562606 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:37.571448 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1460/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:38.922431 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:38.931075 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502baed-2199-4a4f-938a-b70643a4b171 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:38.934833 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b789d4e183f94b22b09e491728614fd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:38.935446 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:38.935733 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:38.936014 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:38.945642 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:38.947087 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36e5a-d9a5-45d2-964d-9495263ef52e service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:38.956507 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1431/2891] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:43.526206 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:43.589022 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb003e-d3a0-44cb-bbbe-5495c4f4b12c service cinder] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:43.593647 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:43.594317 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:43.594603 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:43.594882 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] PATH_INFO: `/v3/users/cf2c4a7396994dda943290653aa1abd8` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:43.596045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2c4a7396994dda943290653aa1abd8)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:43.597998 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:43.800644 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2c4a7396994dda943290653aa1abd8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:43.801300 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2c4a7396994dda943290653aa1abd8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:43.813889 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2c4a7396994dda943290653aa1abd8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:43.820799 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2c4a7396994dda943290653aa1abd8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:43.878933 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2c4a7396994dda943290653aa1abd8'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:43.885628 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1461/2892] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:43 2022] DELETE /identity/v3/users/cf2c4a7396994dda943290653aa1abd8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:43.890274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:43.890762 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:43.890878 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:43.909990 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] MFA Rules not processed for user `f199c9c45ff44aa0a14a3b7dc647ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:43.911276 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:43.972008 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1432/2893] 10.222.0.49 () {58 vars in 958 bytes} [Mon Aug 1 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:43.984426 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:43.986657 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:44.050757 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30536ed-a2c1-4d5f-9a3a-501177efe059 admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:44.054565 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:44.055180 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:44.055464 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:44.055738 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:44.064641 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:44.066133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:44.076145 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1462/2894] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:44.457875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:44.459524 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:44.475069 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2b5e8-208d-4ffb-9631-a5ce488b5a05 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:44.481156 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:44.482112 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:44.482500 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:44.482782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] PATH_INFO: `/v3/projects/096f190596204bf6b90d62d5f6796536` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:44.484204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=096f190596204bf6b90d62d5f6796536)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:44.486376 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:44.503205 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:44.605875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096f190596204bf6b90d62d5f6796536', 'request_id': 'req-d606bf4c-097d-422f-bd45-dd71b039c27f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.612315 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096f190596204bf6b90d62d5f6796536', 'request_id': 'req-d606bf4c-097d-422f-bd45-dd71b039c27f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.619283 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096f190596204bf6b90d62d5f6796536', 'request_id': 'req-d606bf4c-097d-422f-bd45-dd71b039c27f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.689805 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] The token cache is being invalidate because project 096f190596204bf6b90d62d5f6796536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:44.690213 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.690886 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.692405 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1433/2895] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:44 2022] DELETE /identity/v3/projects/096f190596204bf6b90d62d5f6796536 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:44.697289 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:44.707037 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83953b0f-fdc5-4ea9-b0f2-700dec813bad service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:44.718474 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:44.765433 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:44.766310 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:44.766677 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:44.766956 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] PATH_INFO: `/v3/users/2cb2f4780a2a499bbb04d64526f2fc84` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:44.768164 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb2f4780a2a499bbb04d64526f2fc84)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:44.770201 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:44.967705 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb2f4780a2a499bbb04d64526f2fc84'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.968423 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb2f4780a2a499bbb04d64526f2fc84'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.981200 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb2f4780a2a499bbb04d64526f2fc84'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:44.988240 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb2f4780a2a499bbb04d64526f2fc84'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.067502 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb2f4780a2a499bbb04d64526f2fc84'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.073976 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1463/2896] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:44 2022] DELETE /identity/v3/users/2cb2f4780a2a499bbb04d64526f2fc84 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:34:45.513930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:45.515855 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:45.528693 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf4c-097d-422f-bd45-dd71b039c27f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:45.587890 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:45.588537 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:45.588819 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:45.589099 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] PATH_INFO: `/v3/projects/c0e74f933ea54bc5a42a328fc2ebeb8a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:45.590296 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e74f933ea54bc5a42a328fc2ebeb8a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:45.592204 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:45.720562 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e74f933ea54bc5a42a328fc2ebeb8a', 'request_id': 'req-89bcda08-bced-4bb3-a673-553484545c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.727140 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e74f933ea54bc5a42a328fc2ebeb8a', 'request_id': 'req-89bcda08-bced-4bb3-a673-553484545c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.734602 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e74f933ea54bc5a42a328fc2ebeb8a', 'request_id': 'req-89bcda08-bced-4bb3-a673-553484545c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.804241 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] The token cache is being invalidate because project c0e74f933ea54bc5a42a328fc2ebeb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:45.804534 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.805148 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:45.806766 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1434/2897] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:45 2022] DELETE /identity/v3/projects/c0e74f933ea54bc5a42a328fc2ebeb8a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:45.810775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:45.812339 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:45.826592 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f9e8-e083-4fb0-b5b5-a00f07ff22cc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:45.883836 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:45.884487 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:45.884778 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:45.885059 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] PATH_INFO: `/v3/users/d3fe2185d3354b0e9b78ce61318d4800` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:45.886255 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fe2185d3354b0e9b78ce61318d4800)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:45.888189 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:46.096191 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:46.104736 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fe2185d3354b0e9b78ce61318d4800'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.105381 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fe2185d3354b0e9b78ce61318d4800'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.118228 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fe2185d3354b0e9b78ce61318d4800'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.124985 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fe2185d3354b0e9b78ce61318d4800'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.194526 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fe2185d3354b0e9b78ce61318d4800'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.202574 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1464/2898] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:34:45 2022] DELETE /identity/v3/users/d3fe2185d3354b0e9b78ce61318d4800 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:46.628647 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:46.630274 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:46.643477 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcda08-bced-4bb3-a673-553484545c88 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:46.675867 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:46.702292 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:46.702944 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:46.703227 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:46.703508 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] PATH_INFO: `/v3/projects/54cbf12c82cd431aa7683541ba4fac02` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:46.704651 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cbf12c82cd431aa7683541ba4fac02)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:46.706718 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:46.813930 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cbf12c82cd431aa7683541ba4fac02', 'request_id': 'req-9bba244a-be35-4254-ba6f-761b106ce7a6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.821229 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cbf12c82cd431aa7683541ba4fac02', 'request_id': 'req-9bba244a-be35-4254-ba6f-761b106ce7a6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.827286 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cbf12c82cd431aa7683541ba4fac02', 'request_id': 'req-9bba244a-be35-4254-ba6f-761b106ce7a6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.915163 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] The token cache is being invalidate because project 54cbf12c82cd431aa7683541ba4fac02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:34:46.915505 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.916312 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:34:46.917904 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1435/2899] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:34:46 2022] DELETE /identity/v3/projects/54cbf12c82cd431aa7683541ba4fac02 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:34:56.261013 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:56.909703 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:09.861435 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:09.862887 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:09.924012 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c580aa-43d2-480a-ac0d-391900472ddc admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:09.973132 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '736ade5de27a48319e720a6f968c0239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:09.973775 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] REQUEST_METHOD: `GET` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:09.974062 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:09.974340 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:09.976834 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:10.046412 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:10.049188 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:10.059911 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1465/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:35:17.409919 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:17.411447 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:17.425509 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba244a-be35-4254-ba6f-761b106ce7a6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:17.431024 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:17.431701 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:17.431988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:17.432265 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] PATH_INFO: `/v3/users/cc8d9f649a43450da28c0f7c2e4515ec` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:17.433457 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8d9f649a43450da28c0f7c2e4515ec)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:17.435411 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:17.627782 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8d9f649a43450da28c0f7c2e4515ec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:17.628451 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8d9f649a43450da28c0f7c2e4515ec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:17.641875 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8d9f649a43450da28c0f7c2e4515ec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:17.645137 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8d9f649a43450da28c0f7c2e4515ec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:17.711086 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8d9f649a43450da28c0f7c2e4515ec'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:17.723545 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1436/2901] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:35:17 2022] DELETE /identity/v3/users/cc8d9f649a43450da28c0f7c2e4515ec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:18.004786 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:18.016093 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7e044-fa54-4dbe-a953-6b80116bf304 service neutron] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:18.076661 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:18.077407 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:18.077767 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:18.078045 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] PATH_INFO: `/v3/projects/1d34ed67668c475695dbd57530aa6d49` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:18.079184 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d34ed67668c475695dbd57530aa6d49)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:18.081346 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:18.090468 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=100 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:18.219938 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d34ed67668c475695dbd57530aa6d49', 'request_id': 'req-188021fc-1f65-4515-8db1-5d61be23535a'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.226133 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d34ed67668c475695dbd57530aa6d49', 'request_id': 'req-188021fc-1f65-4515-8db1-5d61be23535a'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.231595 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d34ed67668c475695dbd57530aa6d49', 'request_id': 'req-188021fc-1f65-4515-8db1-5d61be23535a'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.310930 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] The token cache is being invalidate because project 1d34ed67668c475695dbd57530aa6d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:35:18.311224 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.311937 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.313473 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1466/2902] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:35:18 2022] DELETE /identity/v3/projects/1d34ed67668c475695dbd57530aa6d49 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:18.317472 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:18.319064 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:18.333191 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281f59-d150-4073-ac2a-2a1ad27af9c8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:18.392849 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:18.393499 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:18.393827 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:18.394105 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] PATH_INFO: `/v3/users/c8459ae21eed4873bf322d8f46d2152b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:18.395291 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8459ae21eed4873bf322d8f46d2152b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:18.397734 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:18.623965 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8459ae21eed4873bf322d8f46d2152b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.624658 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8459ae21eed4873bf322d8f46d2152b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.636467 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8459ae21eed4873bf322d8f46d2152b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.637164 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8459ae21eed4873bf322d8f46d2152b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.700829 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8459ae21eed4873bf322d8f46d2152b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:18.702988 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:18.714178 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1437/2903] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Aug 1 14:35:18 2022] DELETE /identity/v3/users/c8459ae21eed4873bf322d8f46d2152b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:18.971500 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Authenticating user token {{(pid=80459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:18.972972 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.fernet_utils [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:18.986913 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188021fc-1f65-4515-8db1-5d61be23535a admin admin] Validating token access rules against request {{(pid=80459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:19.045906 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f199c9c45ff44aa0a14a3b7dc647ab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40846723d7f04d9ab8a9bf11d431617b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:19.046626 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:19.046816 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:19.047088 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] PATH_INFO: `/v3/projects/72bec93871ca4ad8802ca49edcb585ea` {{(pid=80459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:19.048307 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bec93871ca4ad8802ca49edcb585ea)` {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:19.050239 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] RBAC: Authorization granted {{(pid=80459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:19.141541 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bec93871ca4ad8802ca49edcb585ea', 'request_id': 'req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:19.147910 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bec93871ca4ad8802ca49edcb585ea', 'request_id': 'req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:19.154695 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bec93871ca4ad8802ca49edcb585ea', 'request_id': 'req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e'} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:19.214659 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] The token cache is being invalidate because project 72bec93871ca4ad8802ca49edcb585ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:35:19.214881 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:19.215524 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG keystone.notifications [None req-fc87ff51-497c-4a70-8cbf-8da25a0d5c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:19.217027 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: [pid: 80459|app: 0|req: 1467/2904] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Aug 1 14:35:18 2022] DELETE /identity/v3/projects/72bec93871ca4ad8802ca49edcb585ea => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:28.821481 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:29.211498 dv-cinder-787296-13-iscsi devstack@keystone.service[80459]: DEBUG dbcounter [-] [80459] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:39:32.921611 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:39:32.923055 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:39:33.069256 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653865d6-1f8f-49bc-acb9-65ed55e9c0a4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:39:33.127415 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429f98d35a844c0190fcc7aca87e2e1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '795fb0432e984025b689745107879b62', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:39:33.128062 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:39:33.128345 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:39:33.128619 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:39:33.130392 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:39:33.141772 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:39:33.143335 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ce4f-c763-42aa-9c16-357f5d1ad1a5 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:39:33.153690 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1438/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Aug 1 14:39:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:39:43.149496 dv-cinder-787296-13-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}